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ABSTRACT 

The purpose of this investigation was tc empirically 
demonstrate and evaluate a brassboard for ccmpi3teri2ed collective 
training for teams (C0LT2) • The underlying tasks were tc (1) conduct 
a state of the art assessment of instiQctiocal strategies appropriate 
for C0LT2r (2) derive a conceptual f'ramemork for CCII2 instructional 
strategiesr (3)- conduct a team , job/task and training analysis for 
C0LT2 on the Army- computerized artillery fire ccnticl system 
(TACFIRE) ^ and (4) develop TACFIRE team training scenarios for the 
tlurpose of instructional strategy as:^essmect. The procedures included 
design and implementation of ar team I£D model, via vhich sample 
training materials nere developed. The materials were adapted tc the 
team training version of the PEANIT CAI system. The resalts of the 
developmental aspects of the project indicate that many of the 
components of the team ISD approach that were designed fcr this 
effort would adeguately meet the criteria for a generic team ISD 
model. Preparation of team learning otjectives and evaluation, of 
interactive team skills are deficient areas. PLANIT met tie basic - 
team CAI reguirements. The resu^s prglimanaiily indicate that there 
are differences in regard to what types of behavicr are learned 
between team and individual instruction. (Atsthox/JilG) 
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The Educational Technology and Training Simulation Technical Area of the 
Army Research, Institute for the Behavioral and Social Sciences (ARI) conducts 
research to support the development of training concepts and evaluation tech- 
niques for applying automation, simulation and training devices in a unit 
setting. A training concept currently under study is the use of automation, 
viz., tactical computers, for training. Tactical computers have great poten- 
tial for presenting individual and collective (or team) training. Individual 
training using the tactical coa^uter has been developed and evaluated. The 
develt>pment of team training was an expressed priority of the recent Defense 
Science Board Report to the Director of Defense Research and Engineering. In 
.ant^cii>ation of the Defense Science Board Report, the present Technical Report 
(and a^^previously issued companion report - ARI Technical Report TR-77-A4) 
revie^av tljie problems of the development of instructional strategiesTfor con-- 
ductin^^\t^^^ training and examines the potential of the computer 
and monitoring team training. 
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COMPUTERIZED COLLECTIVE TRAINING FOR TEAMS 
BRIEF ' 
Requirement 

Past research on team training has not focused,- to any substantial degree, 
on establishing a methodology for developing team training curricula or on 
investigating the potential of computer technology as a delivery system ^or 
team training. The major purpose of this study was to develop an approach for 
designing team training scenarios and testing the feasibility of the team 
training version of the PLANIT CAI system as an instructional medium for 
scenario presentation. — 

The project objectives were as follows: 

1. To determine from the existing literature, previous surveys, personal 
contacts and other related sources the information which exists with regard to 

findings and instructional theory directly applicable to the 
problem of developing instructional strategies for computer-assisted team 
training. - 

'7'* \ ' ■ 

2. To derive historically, analytically and/or empirically a conceptual 
framework, fleshed-out with detailed principles, for a general purpose (non- 
job or system specific) set of instructional strategies applicable to team 
training problems in a computerized setting. 

3. To conduct a detailed job/task analysis for two classes of team 
training: (a) the man-computer-man paradigm, and (b) the man-(non-computer)- 
man setting. 

.4. To develop an appropriate scenario representative of and permitting 
the assessment of the job/task analysis and which will permit the insertion of 
objective 2 team training strategies into the scenario in order to make it a 
training scenario rather than a purely drill and exercise vehicle. 



5. To construct, demonstrate and evaluate a "brassboard" team training 
system which ties meaningful aspects of all project findings tpgether. 

Procedures ; 

Bulldihg on an empirical and theoretical base established In prior 
research, a conceptual framework for deriving team training Instructional 
strategies was developed. In turn, generic individual Instructional systems 
development (ISD) techniques were adapted to a team training ISD model. The 
model was utilized to derive the team training sp^lf lea t ions for a segment of 
the U.S. Army's computerized artillery fire control system, TACFIRE, operations. 
On the basis of these specifications, sample training materials which reflected 
a selection of team, instructional strategies were developed and adapted to the 
team training version of the PLANIT computer assisted instruction (CAI) system. 
The 'brassboard 'v of computerized colle ctive t^rainlng for teams (GOLT^) was 
demonstrated and evaluated at the U.S. Army Research Institute for the Behavioral 
and Social Sciences in Arlington, VA. 

Findings 

Team operations occur in a situational context which Is a continuum; the 
end points of which are described as established or emergent. An established 
situation is one for which performance requirements are specifiable, predlct- 
able, and comply with standard operating procedures. In an emergent situation, 
the environmental conditions during the performance requirements are unantici- 
pated; and the state of the system does not comply with standard operating 
procedures. Teams operate along this continuum in either serial or parallel. 
" Serial* activities are sequential with the input for one team member based upon 
the output of another. Parallel team structures are characterized by team 
neinbers performing the same or interrelated tasks simultaneously. 



Team instructional strategies are defined as the product of a series of 
decisions whichjprovide for the structuring of learning activities by three 
types of information: (1) the nature of the task to be learned, (2) the 
characteristics of the learner and learner strategies, and (3) the capability 
of the instructional delivery system. Underlying the development of team 
instructional strategies, there is needed a team ISD model by which the 
specifications of the instruction can be derived. The model should identify 
team task dimensions, team objectives, and the scope, and sequencing of specific 
learning events for both established and emergent contexts and for both serial 
and parallel structures. 

Team training scenarios are task and environment specific in nature. 



That is, there must be adequate incorporation of team task interactions in the 
instructional strategies underlying the scenario. Then the team interactions 
must be placed in a simulated tactical environment. Rich combat representa- 
tions built into the scenarios may be critical in order to involve a COLT^ 
trainee at more than a drill and practice level. 

The team version of PLANIT adequately provided for the four major team 
CAI considerations: . (1) multi-person initialization of lessons, (2) communi- 
cation among team members , (3) synchronization of team members and scenario 
events, and (4) manipulation of a common data base for storing and retrieving 
scenario-related information. Enhancements are required to increase the speed 
of the operating system, to provide greater flexibility in communications, and 
to facilitate authoring pr.ocedures. 

The results of the demonstration/evaluation, while limited in inferential 
power due primarily to the small number of subjects and the anecdotal nature 
of the evaluation, indicate that thf re are differences between the effective- 
ness of team and individual instruction in regard to what types of behavior 

•v 

being learned. Supporting this claim are the following observations: 



1. The coordinated (team) training did not seem to increase individual 
skills as well as continuous individual training, 

2. There appears to be little stability among independent variables iFor 
explaining variance in subject scores between individual and team contexts, 
and * 

3. Coordinated behavior lends to better achievement on specific tasks. 

Utilization of Findings 

The findings of the study impact on three team topics: (1) the development 
of a team ISD model, (2) requirements for a team CAT system, and (3) require- 
ments for team training research. Recommendations for future developmental 
efforts are suggested for each topic. 

Generally, the team ISD approach as designed and implemented was insuffi- 
ciently fleshed out to serve as a step-by-step procedural guide for developing 
team training. Deficiencies include (1) a methodology for preparing, analyzing, 
and categorizing team learning objectives, -(2) evaluation designs which would 
address team member interactions as well as Individual and team achievement, 
and (3) the incorporation of applicable knowledge regarding small group 
behavior into the data base of the conceptual framework for COLT^ instructional 
strategies. 

Recommendations for the enhancement of PLANIT focused on software modifi- 
cations that would improve system operations and flexibility and design 
modifications to facilitate authoring procedures. Recommendations for future 
research en5)ha8^ized (1) investigating the relationships of team personnel 
con5>osltes, achievement, and modes of COLT^, and (2) testing TACFIRE training 
scenarios in an operationail setting. 
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% , INTRODUCTION 



Team training has been an active topic in Department of ^Defense and 

^ ■' J ■ . 

Civilian Sector training research arenas for over two decades. Research 

projects addressririg thq subject have been extensive and have identified many 
problems whose resolution is critical to effective team functioning. Yet to 
y^date, R&D efforts have neither resulted in the establishment of a methodology 
for developing team training curricula or, to any substantial degree, investi- 
gated the potential of computer technology as an effective and efficient 
.delivery system for team t^aininj 



With the advent of icomp lex computer-based weapon systems which necessitate 

•'^ I ^' ^. ^6 : y ... ■ \ 

coordinated actions of multiple operators and decision makers, team training 
of system users has become a critical need. Recognition o'f the problem by the 
Anuy has lecL to the initiation of related research projects by the -U.S. Army 
Research Institute (ARI) and by the Defense Advanced Research Projects Agency 

' • ^ . s . * ■ • ■ 

(DARPA). Further, the ARI research which is current V focused on the use of 
computerizeci tactical data systems as a major sindividual training medium is 
being^^^cjiended to include investigations of the feasibility and effectiveness 
Vof embedding team training, on the Army's computerized artillary fire control 
system, TACFIRE. 

The project final report which foJLlows provides the results of the design 
and^ application of a team instructional system design (ISD) methodology in the^ 
development of computerized colle ctive _training for teams (COLT^) . In essence, 
^ the design of the team ISD. model involved extending generic individual instruc- 
tion systems design concepts to "encompass team training aspects and subsequently 
developing a computer assistance instruction (CAI) team training brassboard 
based ^ the team ISD approach. Thus, the methodology directly relates existing 

. \ ■ ;r, ■ • ■ ' . . 

knowledge regarding various dimensions of individual and team training to the 



. - ■ / - 

development of a specific team computer-assisted instruction brassboard. In 
turn, the brassboard reflects a sampling of insttuctional stratiegies which, 
account for three critical components of team training :*^(1) team task dimen- 
sions, (2) individual learner characteristics, and (3),.CAl capiabilities. 

. The COLT^ lessons developed and evaluated were design'ed to address a 
specific operational Army team, an ^rtillei^ battalion TACFIRE Fire Direction 
Center ceam composed of a fire direction officer (FDO) and a fire direction - 
sergeant (FDS) . The team training- issues which emerged during the course' of 
the project are not, however, delimited by the specific team environment being 
de^lt with, but rather are generic to the preponderance of military team 
training. The issues are complex arid make it clear that a single team .training 
methodology without flexibility will not suffice as a derivator of team traln-r 
ing requirements and as a guide to the development of effective team instruction. 

It is our belief that the team training approach demonstrated in this 
project embodies the- comprehensiveness required of a team ISD model atid possesses 
the flexibility required for application to a broad range of team environments. 
The conceptual structiure of the project, with the supporting empirical data, 
indicates that the representation of the intersection of team task dimensions, 
individual learner characteristics', and instructional delivery system in 
instructional strategies is critical to effective team training. In 'turn, the 
methodology proved effective in deriving team task dimensions and as a guide 
for team currlcular materials development. The methodology, however,, is far 
from being fleshed out in detail or from being adequately tested. 

Organization of .Final Report 

,The remainder of the Final Report is organized as follows: The 
introduction .presents a brief description of the TACFIRE training research 
which leads up to this effort, and a listing of the specific tasks undertaken 



in the present project. The second section contains an overview of the 
fundamental issues underlying team training and their implications for develop 
ing. teairf training programs. The third section provides a discussion of a 
conceptual framework frote^hich COLT^ instructional strategies may be derived. 
Primarily, the three criticaL components of COLT^ instructional strategies- 
team task dimensions, individual learner attributes, and CAI capabilities— 

o 

are reviewed. Section four provides a description of the brassboard develop- 

* ■ - 'V ■ 

ment. The major focus is on'describing the results' of implementing the, team 

ISD model and the development of the training scenarios. 

,The results of the brassboard demonstrations are documented in section 

five. The sixth section is a discusS'ion of overall project findings. Section 

seven contains recommendations. 

Background to TACFIRP Training Research 

As part of a long range plan, ARI is eng-«ged' in an effort to maximize 
utiliMtijg^ of tactical data systems, to meet tactical training heeds. The 
first phase of ARI-' s effort toward' using tactical systems in an instructional 
mode involved the MASSTER test 122 "IBCS: Automated Instruction" project. ^ 
This project demonstrated the feasibility^ of 'using, a prototype tactical data 
processing system in a stand alone mode to. support unit training requirements. 
The instruction developed, however, was not related to training of system 
users. , 

The secojid phase of the ARI effort to employ tactical data systems "for 
instructional purposes involved embedding training that was directly related 
to the operation of the tactical system itself . s One benefit of embedded 
training is that it can .provide training at the unit level and location, 
thereby reducing or eliminating the need to send personnel away to school. 
Embedded training also accomplishes • general fmniliarization with the tactical 

3 
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data system through a self-instructional mode. That is, personnel who* are 
operators or who are involved in maintenance of a tactical data system are 
likely to have little experience with computers. Thus, instructional material 
embedded in the tactical data system offers an additional opportunity to 
become familiar with system equipment and operational characteristics. 

In May ART contracted with System Development Corporation for the 

development of embedded self-instructional programs for users of the TACFIRE 
system. The overall aim of the effort was to extend the scope of computer- 
assisted instruction tor' the development of self-instructional programs and 
procedures for TACFIRE users. . The basic approach was to embed a training 
subsystem package within the operating TACFIRE system and to use the system 
itself to train personn'el in its operation and maintenance. The training 
goalsc^^f the courseware to be used in the embedded mode were: 

1. To present techniques to aid the users, in learning how to operate the 
system. . . ^ ' • 

2. To exercise and^update system related skills. " 

- 3. To provide on-line situational problems which enab^le the users to 
exercise all the skills previously acquired (Hoyt, Butler and Leungj 1976. 

TACFIRE courseware, using the PLANIT language, was developed and produced 
in five functidnal areas. ,'5he average course time for this individualized, 
self— paced, embedded tra^lning program is approximately 40 hours and covers an 
estimated 25 to 35 percent of "the Battalion Fire Direction Center operations 
(Hoyt, et al., 1976). " 

The present project, initialized in August 1976,^ represents an extension 
of the; scope of embedded TACFIRE training. The previously mentioned course- 
ware was designed to develop 'and maintain indlii^idual skills in operating the 
TACFIRE system. The" objective of the present project is to demonstrate and 
evaluate training of TACFIRE system personnel operating as a team. 



Team training is a function of the requirement for coordinated activity 
within the TACFIRE environment. As a computerized command/control system, 
TACFIRE has a number of characteristics that are common to all such systems. 
For example, the system is operated by teams of people whose interaction with 
each ot^ep-,±n the environment is mediated by the computer complex with associ- 
ated input;/,9utput requirements. Within this sophisticated and complex computer- 
based weapon system e^ivironment , it is essential for personnel to 'cooperatively' 
perform tasks. The division of individual responsibilities and the team 
member interactions require a broader training scope to be taken than .currently 
exists. Therefore, the ultimate goal of this project is to investigate the ' 
feasibility of extending the concept of embedded CAI training beyond individual 
instruction to the training of teams. 

* jf. " 

. ■■ ■■ i 

Project Tasks and Objectives/ ^ 

The project tasks and/bbjectives are listed below. I 
^^^^ ^- — State-of- the-art assessment of instructional strategies .foi; com- 
puter-assisted team traininfr. To determine, from the existing literature! 
previous surveys, personal contacts and other related sources the information 
which exists with regard to-'state-of-the-art findings and instructional theory 
directly applicable to the problem of developing instructional strategies!, for 
computer-assisted team training. 

/^^^^ ^- — Derivatio n and development of Instructional strategies for com- 
puter-asaisted team trainim>. . To derive historically, analytically- and/or 
enq>irically a conceptual framework, fleshedrout with detailed principles, for 
a general purpose, (non-job or system specific) set of instructional strategies 
applicable to team training problems in a computerized setting. 

] Task 3; . Job/task an d training analysis for computer-assisted TACFIRE 
/ • ' . . "i ■ 

tjeam training. To conduct a detailed job/ task analysis for two classes of - 
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team training: (1) the man- computer-man paradigm, and (2) the man-(nonr?. . 
computer)-man setting. 

Task 4: Scenario development for Instructional strategy assessment . To 
develop an appropriate scenario representative of and permitting the assess- 
ment of the job/ task analysis and which will permit the Insertion of Task 2 
team training strategies Into the scenario lii order to make It a training 
scenario rather than a purely^ drill and exercise vehicle. 

Task 5: Development and demonstration/evaluation of a "brassboard" com- 
puterized team training system . To construct, demonstrate and evaluate a 
"brassboard" .^team training system which ties meaningful aspects of all of the 
preceding Tasks together. ' 



AN OVERVIEW OF MAJOR TEAM ISSUES 

Team Definition 

Task 1. a state-of-the-art assessment of instructional strategies for - 
computer-assisted team training, had as its objective the determination of 
the applicability of findings of previous research efforts to the problem of 
developing instructional strategies for computer-assisted team trainit^g. In 
the undertaking, of this, task, the Project Team was quickly confronted with the 
complexity of team training issues and with the lack of unanimity withi. the 
research connnunity regarding these issues. For example, two extensive reviews^ 
of team training (Hall and Rizzo. 1975; l^agner. Hibbits. Rosenblatt and - 
Schulz. 1976) identified the difficulty in defining team and ; team training. 
As ,pted by Hall and Rizzo "no <one seems to be able to articulate its [team] 
dimensions with sufficient clarity to permit the development of training 
procedures for producing it.- it was further stated in this report that 
another major issue that lacks resolution was/the determination of whether a 
team is si:iply a.xollection of individuals performing separate task Jobs in a 
group context or if there are unique trainable team skills that exist over and 
above individual functions.^ • ^ 

The first of these issues.- that is. the definition of a team, was resolved 
by employing an .existing description of a team. The description .as based on 
observations of fered by Klaus and Glazer (1968) . They stated: 

lilatiJTlv'f"'"^?^"^ "^^^ organized, highly structured and has 
baseball Lf^™:' operating .procedures - as exemplified by a 
•generaUy: ' " ^^^P Teams 

^ ^i"Ji^\lLort' organization and com- : 

• (2). Have well defined positions or numbers assignments so 
that participation in a given task by each SSwuII 
can be anticipated to a given extent individual 



(3) Depend on the cooperative or coordinative participation 
of several specialized individuals whose activities con- 
tain a litt^le overlap and who must each perforin their 
task at least at some minimum level of proficiency. 

(4) Are often involved with equipment or tasks requiring 
perceptual motor activities. 

(5) Can be given specific guidance on job performance based 
on a task analysis of the team's equipment, mission or 
situation. 

Thus the criteria for team definition include: (1) rigid structure, 
orgaiiization and communication networks, (2) anti^cipation of an individual's 
task participation by virtue of well 'defined assignment's, and (3) cooperation 
and coordination. ' 

Conceptual Team Models . ' . 

^ The second major team training issue is related to the conceptualization 
of teams into two models. These models are referred to as "stimulus response" 
and as "organismic". Alexander and Cooperband (1965) distinguish between the 
two team training models based on situations in which the team behavior takesl^iL . 
place. The stimulus response model was applied to teams which operate primarily 
in an established situation where tasks and the activities required to perform 
the operation can be completely^ specif ied and assignment of functions among 
team members and equipment is relatively rigidV In the organismic model, the.' 
team is considered to 'be a synthetic organism of, which individuals are com- 
ponents. -This model is oriented towards teams operating in an environment 
which includes a significant proportion of emergent situations. ^ In emerg'ent 
situations, there are defined task assignments; however, the individual has a 
considerable degree of discretion as to how to perform the task given various 
contingencies. Consequently, team performance depends on the development of 
appropriate team procedures for coping with environmental contingencies more 



so than on individual job proficiency. . Thus, adaptive innovations are required 

by team members, and decision making and problem solving skills are critical. 

The two conceptual approaches take as their bases the situational contexts 

in which team behavior occurs. In actuality, the situational context is a 

continuum, the end points of which are described as established or emergent. — 

Boguslawaad-Porter (1962) define these situations as follows: 

An established situation is one in which (1) all action-relevant 
environmental conditions are specifiable and predictable, • 
(2) all action-relevant states of the system are specifiable 
^J^;^ . and predictable, and (3) available research technology or . 

records are adequate to provide statements about ;the .probable 
consequences of alternative actions. An emergen^^ situation is 
one in which (1) all action-relevant environmental conditions ■'' 
have not been specified, (2) the state' of the system does not -J 
correspond to relied upon predictions,! and (3) analytical solu- 
tions are not available given current btates of analytical 
technology, j 

The two conceptual viewpoints have also served as contexts for team - 
training resi^arch. For example, investigation of team member interactions in 
an established, situation was a primary focus of a team training laboratory 
program at the American Institute of Research (Klaus and Glaser, 1960). There 
are obvious advantages to the -team training laboratory research, but the often 
necessary simplification of the team fiifictions can mask or omit possible 
important variables which influence behavior in the real world. 'Abstracting 
the situational contexts in the laboratory can result in a loss of opportunity 
for trainees to react to breakdowns or problems which may arise in an opera- 
tional setting (Wagner, etal., 1976). 

Providing skills to deal -with emergent unstructured situations was seen 
as a maijor goal of an earlier team training program (Alexander and Cooperband, 
1965). The development of coordination skills was stressed although it was 
recognized that these are based upon attainment of minimum individual skills. 
In turn, team training devices and techniques were seen as requiring orientation 



for training innovative behaviors 'and skills necessary to adapt to unforeseen 
problems. It was agreed that, emergent situation training permits a more 
realistic, less abstract approach than established situation training. In the 
emergent case> what seems to be important is training team members to become 
fully aware of their responsibilities, to compensate for the inability of 
others, and to overcome temporary problems when the situation calls for it. 

It is obvious that in actuality, no team operates in -purely an esteblished 

or an. emergent situation. Therefore, in conducting the job/task and training 

% • . - • 

analysis, emphasis was placed -first on defining the precise TACFIRE established 
situation as prescribed by standard operating procedures and, secondly ,>oti 
identifying the most common and critical emergent situations that Impact 
actual operations of the TACFIRE system. By defining both the established and 
the emergent situations, the team member interactions which occur in both 
cases could be analy.zed in order to determine the team task dimensions that 
are present.' 

Team Structure 

A third major issue underlying the development of team training is related 
to the structure ^interaction of team members) of team operations. Basically, 
teams function either in serial or parallel. . In a serial or vertical structure, 
activities are sequential with input for one team member based upon output of 
another. Parallel team sti:uctures are characterized by team members performing.-. 
the same or similar task8;^^±taultaneously. 

Research related to team structure and effectiveness has had mixed results, 
^^or example, Briggs and Johnston (1967) suggested that parallel team structures 
afe preferable to. serial structures because team performance in the parallel 
structure is not dependent on the least skilled member." On the other hand, 
Klaus an4 Glaser (1968) reported that the parallel structure led only to a 
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short term gain and eventually to a decrement in team performance. There 
is, however, one. point of agreement. In a purely established situation the 
serial team structure results in better performance. In the same situation, 
parallel structures seem to inhibit or slow down team performances. On the 
other hand, in emergent situations, team failure is frequently a function of 
individual skill deficiency. Teams apparently respond more effectively to 
emergent tasks if a parallel team structure is in effect. 

In a TACFI^^. operation there is neither a pure serial nor parallel team 
structure. What \commonly is the case, is that more than one team member will 
receive similar inputs, but the responsibility for output is predetermined 
by standard operating procedures. In the event of emergent or contingent 
situations, more than one team member is prepared tor should be prepared to 
address problems which arise. " 

Iipiplications for Team Training 

Each of the previously discussed issues should be 'taken into/consideration 
by the developer of a team training curriculum. First, the definition of a 
team contains certain' criteria which distinguish it from the multi-individual 
task context as well as a small group. Ultimately, it is these same criteria 
which seijve as the foundationer developing- and implementing a team ISD 
approach In order to derive instructional strategies for the training. For 



a. 



example, if the criteria of (1) a rigid structure, organization and communication 

r . - " 

network, (j2) anticipation of an individual's task participation and (3) 
cooperatiop and coordination are not present to some degree, any other 
^issues (i.p. , the conceptual team model and team structure) are mute. 

If thlre is no rigid .team structure or standard operating procedure, it 
Is not possible ^to determine_^aln established situation for the team performance. 
On the other hand, if cooperation and boordination are not integral components 



of the team's operations then emergent situations do not Impact on the team 
as a whole but only on the individuals operating within the group context. 
Further, if there is not over.lap ^^^chin the individuals' task participation 
by virtue of the defined assignments, then the team operation will be in its 
purest sense "a stimulus-response" model and will, in effect, represent only 
a multi-person operation. The inverse of this situation is also true. That 
is, if there are no defined assignments related to specific task operations 
but all individuals are cooperatively addressing all tasks without defined 
structure and organization, then it is- likely that the team is in fact a 
small group, should be defined as such, and the more general ->rules of small 
group behavior applied. 

Once a team has met the criteria for definition as a team, the second 
and third major team training issues discussed begin to have a tremendous 
impaction the subsequent development of the training curriculum^ Primarily, 
the coiinection is via 'the team job/task and training analysis. The team 
job/task and training analysis must be comprehensive enough to provide for 
the identification of both standard operating procedures tasks and unantici- 
pated combinations of known tasks as well- as the emergence of previously 
' unaddressed and untrained to performance requirements. Thus, there is ^a 
direct tie f roir the team model to the establishment of team instructional 
strategies. For exanq>le, if upon analysis of the team tasks there are 
significant emergent requirements, then the instructional emphasis should -be 
more on developing .problem solving and decision making skills within the 
individual team members as opposed to training to rigidly structured responses 
to given situations. 

. . " » ■ 

The issue of team structure (serial vs. parallel) also is directly 

connected to the development of instructional strategies via the vehicle of 
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the team job/ task and training analysis. Once the task and its situational 
context is identified, a last requirement of the job/task and training 
analysis is to identify how the team Is structured in the performance of the 
task. In team operations, there will seldom be a purely serial or parallel 
operation. The likely case for the team operation is that it is a combina- 
tion of serial and parallel structured events. Therefore, the team job/task\' 
and training analysis should define at what points members are performing ') 
the same tasks simultaneously (parallel structure) and at what points the 
task. performance is- a stimulus -response type activity (serial). In'turn, 
the instructional strategies lor dire°cting the student through the learning 
events will reflect the specific training task dimension by team structure 
as well as by situational context. 
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\ CONCEBTUAL FRAMEWORK FOR COLT^ INSTRUCTIONAL STRATEGIES 




As stated earlier, the first interim report contained the results of a 
review of research literature related to the problem of developing instructional 
strategies for COLT^. Additional bases for the report were interviews and 
personal contacts with instructors currently operating in the following team 
training environments: U.S. kaay Field Artillery School (USAFAS), Ft. Sill, 
OklahoBla; Anti-Submarine Warfare (ASW) School, San Diego, California; Amphibious 
Base, San Di^go, -Calif omia; and Fleet Combat Direction Systems Training 
Center, San Diego, California. ^ 

The analysis of the data led to two major conclusions. The first was 

• i ■ . .. ' 

that conceptual framework for a general purpose set of instructional 

strategies for team training does not exist. The second conclusion was that 

an ISD approach to team training has not evolved. The two. conclusions are 

not mutually exclusive. A conceptual framework for team instructional 

strategies must in part rest on a team^ISD approach for extracting the team 

training tasks, establi"shing student attributes and learner strategies, and 

identifying delivery system capabilities and matching them with tasks and 

students. 

Thus, a primary thrust of the Task 1 study was to define instructional 
strategies within a conceptual f r^ework which was responsive to elements 
developed during a team ISD process .v. . Specif ically, the report addressed the 
derivation of instructional strategies for COLT^ by three elements: team 
training task dimensions, individual learner characteristics and strategies, 
and CAI system capabilities'. The remainder of this section contains a 
discussion of instructional strategies based on the Task 1 findings. The 
"^f^cus of the discussion is on the three major elements comprising a team 
instructional strategy and what prior research findings are applicable to 
team training questions. 
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Instructional Strategies 
y The Phrase Instructional strategU. -„as first .escribed in 1961 by ' 
Stol„ro« as tbe logical ao„ of the instruction „itb consideration for 

^branching structures^f or correrUn^ ^ 

_or correcting error responses or applying remediation. 

- concept o. instr.ctional^strat.gies t.s .as been „it. . .or .ore t.an 

by the system approach to c,.ri..l.. .^sign and development. However as 

_ _.P°inted out_by Cropper (1974) , while the literature ^ . 

■^^'^e^ature dn instructional design 
Has .ro. rapi.1. over the last several .ears, the for^lation of instrnct- 
ional strategies Has receive, little s.ste^tic description in ^ost'lSO 

.efinitio^of .J is .eant b, instructional strategies are not 
u=^n. comprehensive or operational. Cropper uses the ter, instructional 
strategies to refer to prescriptive rules for designing instructional events 
■ w ich create learning e^eriences appropriate for the .aster, of behavioral 
.Bjectives. According. to this definition, the emphasis »,st be placed' on 
the properties of behavior to -.hich the instructional events .ust be respon- 

sive and then on the, properties of t-h^ ^ . / 

perties of the instructional events which make them 

responsive. 

The documentation for interservlre rcn . 

interservice ISD procedures does not specifically 

"se the Phrase instructional strategies. However, the XSD components which ' 
are defined .o contain the same elements of instructional strategies as ^ 

defined by Cropper. After job/task analysis, selection of . 

j^oxa, fae^ectlon of instructional 

"tting. definition of objective., and test development, the instructional 
sequence and structure is determined iith specified learning events and 
-tivities. ^us. as With Oropper.s definition, the strategies for meeting 

the required objectives consist of activities for »™ - ' 

civities _for sequencing, structuring, 

and specifying learning events/activities. HH^ecif ically, instructional 



strategies, as defined by Hansen (1970),, are the product of a series of 
decisions which provide for structuring the instruction by such variables as^ 
media choice, content, pacing, level of difficulty, reading- level, or feedback. 

In developing the conceptual framework for deriving team training 

/• . ' . ■ ■ ■ ■ 

strategic^, , it was concluded that these decisions are based upon three types 
of information:, the characteristics of (1) the task tip b6 learned; (2) the 
learner; and (3) the delivery system for instruction. In other words, COLT^ 
instructional .strategies are derived on the basis of task dimensions, learner 
characteristics/sttategies, and CAI capabilities. 

Team Task Dimensions 

A number of team task diinensions were identified in the literature and 
through the personal contacts,* From these dimensions, three categories of 
team learning were developed to serve as a link between team job/task analysis, 
team training objectives, and team instructional strategies. Descriptions of 
these categories are contained in the following paragraphs, 

Knowledge of Team Roles , Central to a team effort is the understanding 
by each team member of the roles — authority, responsibility, and duties — of 
other team members. Moreover, knowledge of team roles includes being able 
to assess the capacity of oneself and ather team members to fulfill the 
prescribed roles. Two skills, self-evaluation and team awareness, were 
identified within this category, 

Self-evaluative skills are important in team training because an effective 
team member must learn to determine when an overload point has been reached 
and assistance is required from another team member (Boguslaw and Porter, 
1962). This skill requires the analysis of one's own errors as well as 
knoiwledge of other members' loads such that determination of reduction of 
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load by another member can occur. Self-evaluation is related to the definitions 
of well-defined, assigned team roles and team goais because evaluation 
cannot occur without these criteria. * 

Team awareness (Kanarick, Alden arid Dan i Is, 1972) centers on the 
knowledge of a team member about the roles of each team individual in relation- 
ship to the need for effective communication and interaction. *That is, team 
awareness, as a task dimension, is related to the criteria of assigned roles 
which are formal and structured. .. 

Team Attitudes . The- terms confidence, aggressiveness, and pride were 
not addressed in the research literature. However, these attitudes and 
their manifestation in team-related behavior were emphasized by the team 
trainers 'hb were interviewed. The instructors indicated that a team member 
must learn confidence in his abilities as an individual and then learn 
aggressiveness in his coordination ,as a team member. The dimension of pride 
also entered into these d.i^cussions. Statements from instructors indicated 
thatt teams must be trained ^toward,, specif ic team goals or a mission, and 
Rride is a critical dimension to be addressed in the training. Most importantly, 
team pride must be related to the aciiievement of a team goal.. 

, Team Communication . While communication is discussed as a coordination 
task for teams, generally t^ie research and theory does not immediately allow 
for derivation of team communication definitions or strategies for teaching. 
However, two studies demonstrate that communication is an important part of 
a coordipation task and training of such coordination skills develops more 
effective performance in a team. . Johnston (1966) , studying two person teams 
in a simulated radar situation, compared coordination skill training to 
individual training with a criterion task requiring communication. The 
findings indicate that performance was more effective when the coordination 
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skill training was given. In another condition, verbal communication was 
not requlr<^d and, as might be expected, the coordlhatlon training wa6 not 
effective in final performance. ' - 

Wllliges (1966) found that; when two channels of communication, verbal 
arid visual, were allowed, the verbal communication training had no effect on 
team performance. Federman and Siegel (1965) found, that the transmission 
quality of the primary sensing data had a deciding influence on team perfor- 
mance for both communications and decisions. These two studies indicated 
that the team job/ task analysis should have some focus on determining communi 
cation channels and the quality of the channels. ^ 

A study which provides some clues to types of team communication, 
especially as applied tp- coordinated ^tasks, was performed by Federman and 
Siegel (1965). This study investigated the relationship between anti- 
submarine warfare helicopter? team performance and the content and flow of 
communications within the team during ari attack. Fourteen different communi- 
cation variables were found to be correlated with an objective performance 
measurement criterion (miss distance). A factor analysis of the fourteen 
communication variables resulted in four factors being identified: (1) 
probabilistic structure, (2) evaluative interchange, 1C3) hypothesis formula- 
tion, and (4) leadership control. 

The factors defined by -these fourteen variables demonstrate the close 
relatioriship between communications and decision processing. As de:^ined by 
the authors of the study, * \ 

Probabilistic Structure is marked by situations in which . /' 

extrapolations contain the thought processes involved in 1 
weighing alternatives, and in questioning an'd searching for 

answers to questions. Evaluative interchange is contained 

in commiinlcatlons in which there are direct requests for 
information and opinion, as well as the responses to these 
requests. Hypothesis formulation categorizes those communi- 
cations involving interpretations of -past performance in the 
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mission and evaluation of future tactics to-be jEollowed.-r 
Leadership control describes communication marked by a role- 
assuming attitude; it serves to define goals and set assiu*:p- 
tions for decision making. 

While the study does not directly address training for these types of 
communication-oriented coordination tasks, the results suggested that the 
four correlated communications variables are te^m task dimensions which 
should be identified by a job/task analysis. 

Summary . The review of the literature described in the first interim 
report provided a framework for analyzing TACFIRE team tasks and for deriving 
team training objectives from the job/task analysis. This framework is com- 
prised of the three learning categories and their specific task dimensions 
as shown in Table 1. . . * 

Table 1. Team Learning Categories and Task Dimensons. 



V. Learning Category 




Task Dimension 


(l)oKnowledge of Team Roles 


a. 


< 

Self-Evaluation 




b. 


Team Awareness 


(2) Team Attitudes 


a. 


Confidence 




b. 


Pride ' 




c. 


Aggressiveness 


(3) Team Communication 


a. 


Probabilistic Structure 




b. 


Evaluative Interchange 




c. 


Hypothesis Formulation 




d. 


Leadership Control 



Individual Learner Characteristics 

For the^ purpose of illustrating the relevance of student characteristics 

— 9 • ' 

to COLT% eii?)hasis will be given to characteristics which' may impact on the 
ability of the student to process information, communicate, make decisions 
and solve problems in a coordinated task environment. In this way a model 
of the learner will be tied to a inodel- of- the subject matter ^nd allow' 
derivation of COLT^ ^strategies. Vjj^ 



Learner characteristics may be used as a basis for a C0LT2 strategy 
w\th preprogrammed decisions or for teaching the learner strategies to use 
during COLT^. To. some extent, cblcTsideration of state characteristics, such 
as the score on the last test, or the current state of anxiety, departs from 
the, concept of entry behavior description because the measures may be used 
as dynamic indicators of a learner- state. However, the discussion, to be 
relevant to'COLT^, must allow both for analysis of learner characteristicis 
which. wili be used in. designing instructional strategies and those which 
will be used during the instructional manipulation in a real-time, dynamic, 
interactive mode. . . 

Dansereau, Actkinson, Long sLnd McDonald, (1974), identified the following 
factors which potentially affect a learner *s choice of strategies. Many of 

the same characteristics have been used in CAI strategies for selecting 

' ■ - 

content, sequencing, and pacing. These factors are intellectual aptitude 

ft- ■ 

and the availability of strategy skills, personality variables, cognitive 

[ J' ' ' ■■ ■ . 

style, reception pref erences, motivation, sex, and 'prior knowledge. The - 

research on each of these factors is too extensive and diverse for even a 

brief summarization* to be iilcluded in this document, but examples of some 

sali,ent findings will be discussed. The purpose in discussing these examples 

of learner characteristics is to demonstrat-e how the general literature may 

be used to generate, hypotheses « concerning learner characteristics and COLT^ 



strategies within the conceptual £ramevork presented" here. The hypotheses 
will have to be answered empirically, , . 




Information, 1^ ak Intellectual aptitude that can Ke measured (Schroder, 
Driver and Steufert, 1967) and that .appears to be an Important factor In 
determining the types of learner strategies upon which an individual can 
call, , The characteristic might be considered for training team members to 
•integrate information about team member roles in relation to the team goal; 
Research suggests that' conceptual complexity can be manipulated through 
trainijcig, (Sieber and'lanzetta, 1966). 

Dainsereau, et al, (1974) employed the Structure of the Intellect Model 
(Guilford and Hoepfner, 1971) as a framework for discussing' the availability 
of learner strategy skills. In the model, the following -five intellectual 
operations .have been identified by f actpj analysis of a large variety of 
paper and pencil tasks: 

(1) Cognition - Immediate^ discovery, awareness, rediscovery, or recognition 
of information in its various forms, comprehension or understanding. 

(2) Memory - -Fixation and retrieval of information in storage. 

(3) Divergent Production - Generation of logical alternatives from - ' 

given information^, where emphasis is upon variety and quantity. 

. . . \ ' 

(4) Convergent Production - Generation of logical conclusion from 
given information, where emphasis is upon achievitig unique or conversa- 
tibhally best outjcomes. . ° 

(5) Evaluation - Comparisons of items of information in terms of 
^yarlables and making judgments concerning, criterion satisfaction; 

Research indicates that the ability to" perform these operations strongly ■ 
relates to achievement (Guilford, Hoepfner and Petersen, 1965; Dunham, Guilford 
and Hoepfner, 1968; . Caldwell, Schroder, Michael and Meyers, 1970). The 
structure of intellect operations may correspond to the basic skill components . 
required for the development and implementation of learner strategies. For 
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this reason, the intellectual operations correspond with the categories of 
learner strategies developed in a subsequent section of this' report. These 
characteristics offer face validity as relevant to a team member's ability 
to process the information communications in either a man-man or man-computer 
man situation. '■ ' 

Personality Variables . Three examples are-provided to illustrate the 
influence personality variables m^ay have on team performance. Dogmatism and 
tolerance of ambigiiity primarily influence strategy selection in tasks 
involving the manipulation of ambiguous or bejiief- discrepant information 
(Rokeachy 1960; Fedther, 1964). The characteristics could be useful for 
communication training involving risk willingness or reluctance as defined 
by Federman and Siegel (1965) and discussed earlier in the section on team 
diinensibns. 

A measure of the personality construct, locus of control, was developed 
by Rotter (1966)* The construct itself is viewed as a generali^zed expectancy 
about control over the environment with a wide variety of situations included 
within the spectrum of generalization* . Internal control refers to the' . 
individual's belief that an event is contipigent on his/her own behavior or 
characteristics. On the other hand, an Individual characterized by external 
control attributes the occurrence^of a significant event to fate, luck, or 
to the control of others or as being unpredictable (Rotter , 1966). Judd, 
0*Neil and Spelt (1974) conducted an extensive review of the research that; 
has appeared islnce Rotter's initial formulation. The research indicates 
that the external subject requires more specific guidelines than the internal 
subject in order to perceive his own needs and take ^he opportunity to 
control. It also appears that increasingly well-defined task instructions 
provide a missing cognitive link for external subjects which helps them to 




Improve their performance. The locus of control characteristic may assist, 
.therefore, in defining instructional strategies, for adapting the feedback 
and prompting to team members during C0LT2 communications-especially those 
associated with decision processing. 
. / Cognitive Styles . Dansereau, et al. , (1974) discuss cognitive style " 
as a characteristic which creates boundaries on the_types of learner strategies 
available to individuals. .Cognitive. styles are" considered to be preferences 
in perceptual organizing and conceptual categorizing of the environment. A 
number of specific cognitive styles have been identified. While we will not 
attempt to go into the specific investigations of the relationship between 
cognitive style .variables and performance, it should be noted that there are - 
■ indications that cognitive styles are a 'variable to be considered in the 
development of adaptive instructional methods which match media or level of 
difficulty to the learner's style. The applicability bf cognitive style 
characteristics to COLjZ ig presented with one example. 

Cognitive style tests, named field dependence/field independence (Witkih. 
Lewis. Hertzman. Machover. Meissnef and Wapner. 1954). measure the ability 
to isolate and process simple information from a more complex informational 
environment. The tests use geometric figures but seem to have correlation 
with a variety of real tasks. Kennedy (1972) found field dependence to be ' 
related' to success in aviation training. The characteristic may have 
applicability to the communication training required for interaction between • 
the "artillery control console operator and fire direction officer iu TACFIRE. 
Each has a separate, display of complex information and each must isolate 
-information from it. The operator must isolate and pass information to the 
officer and the officer must ma.ke; a decision based on that information and 
his own and then pass back. an order to the operator. 



Reception Preferences , Research has jlndlcated that' Individuals have 
pref erencels . f or receiving information in certain ways (Hartnett, 1973). As 
with co^itive styles j these preferences can influence the strategies avail- 
able td a scudent andthe effectiveness of the application of an instructional 
strategy. Reception preference characteristics may j^e i?elated to communica- 
tion training. For example, Willeges (1966) found th^t when two channels of 

communication, verbal and visual, were used in a team, verbal communication 

■ * . . i ■ - ■ 

Reception preference may be jthe reason for students 



training had no effect, 



using only the visual channel and not the verbal chaijnel available to them. 



Motivation, Sex, and Prior Knowledge . It should] also be noted that 



strategies during COLT^ . 



there are a number of otlier individual difference varjiables that could 
potentially influence the selection and utilization of particular learner 

Any comprehensive attempt tb identify these variables 



' - 

and to take theia into acc;ount for COLT^ instructional strategies would have 
to include the motivatior^, sex and prior knowledge of jthe subjects involved 
in the instruction. Each! of these variables has proven to be significantly 

related to learning outcopes. 

I • , 

Summary . The above subsections provide examples , of student entry 
characteristics which may impact on the design and manipulation of learning 
events. The categories oi learner characteristics include (l) intellectual 
aptitude and availability of strategy skills; (2) personality variables; 



(3) cognitive styles; (4) reception piref erencesT and (5) motivation, s,ex. 



and prior knowledge. The research behind the variables presented indicates 
that frequently significant differences in performance and achievement are 
attributable to the individual's composite of values related to these variables. 

Learner characteristics, in turn, may serve in part as the basis for 
instructional design — addressing such issue as content, {sequencing, pacing,. 



levels of difficulty, or Instruction medium. Within COLT^ Instructional - 
strategies, learner characteristics also may serve as the basis for the 
real- tlmiB,, dynamic manipulation of both student and learning events. 

Individual Learner Strategies 

The three categories of learner strategies discussed in this section 
were first developed by DiVesta (1971) and maintained by Dansereau.et al., ^ 
(1974) in a report for the U.S. Air Force. The categories are made up of 
comprehension, memory, and problem solving strategies. The remainder of 
this section will deal^with each of these learner strategy categories- 
attempting to define the parameters of each category and providing a brief 
sunmarization of the state-of-the-art for ieamer strategies included within 
each category. A series of tables corresponding to the learner strategy 
categories is Included in the first interim report for this project. Each 
table includes specific strategies, a summary of the research with implicat'i 
for instruction, and a list of references. The purpose of the tables is' to 
Illustrate the current directions of individual learner strategy research. 

Comprehe nsion Strategies . Comprehension strategies relate to the 
acquisition of cognitive processes that occur during learning. Specifically, 
th^ strategies .which have received the preponderance of attention from' 
researchers are those which attempt to explain how the learner understands. 
As reviewed by Dansereau, .considerable research has been conducted f 6t t/e 
purpose of ascertaining' the facilitatlve effects of coiiq>rehenslon strategies 
In the Instructional process. The discussion on coiiq)rehensioa sfcrategtes 
includes coverage of the effects of organizational strategies (advanced . 
WgMizers, pMsage organization, and post organizers) ^ the effect of queW 
tions, notetaklng,, rule! presentation, presentation of learning objectives, 
and reading- fles^billty. , ' " : . : ^ ,1.. 



'Generally, the research dealing with comprehension strategies has 
progressed beyond the "basic" stage and specific implications for educational 
applications can either be inferred or posited on the" basis of -mpirical • 
findings. Many of the comprehension factors which appear to have a substan- 
tial impact on' student performance also have implications for the development 
•of educational materials. Furthermore, the dimensions of comprehension 
iiBtraftegies for individuals, appear to hold for team training. 

Comprehension strategies are closely associated with team awareness. 
For example, a number of , -researchers have demonstrated that students tend to 
' Paganize external stimuli in consistent , systematic -patterns (Dansereau, et 
al., 1974; Cofer, 1966). In turn, the preorganization of instructional 
materials to correspond with those patterns hds led to nure efficient learning 
- since the student is not as dependent on rational* processes . In team aware- 
ness training, the.organizational structuring of the materials in terms of 
content, sequencing, and display may be critical if the desired learning is 
to. occur:. ., 

Memory Strategies. Atkinson and Shiffrin (1968) have argued for the 
importance of strategies in determining, which' information is entered into 
and; retrieved from short- and long-term storage. These authors/refer to 
processes that are not permanent features of memory, but rather transient 
phenomena under the control of the subject, as control, processes . The 
appearance of these processes depends on such factors as the instructional 
set, the experimental task, and the past history of the subject. The purpose 
of this section is to discuss specif ic 'examples of these control processes 
as memory strategies, and if possible, to extend them into the instructional 
domain. . - 



Memory strategies include the presentation of selection cues, mnemonic ' 
techniques, visual imagery, subjective organization, memory management, and 
retrieval. Of the learner strategies listed, the first* three appear to have 
direct and positive implications for instructional settings. Subjective 
organization, memory management, and retrieval strategies, on thfi other 
hand, have' riot: proven, as yet, to constitute' viable operational strategies 
for the development of instructional materials or for the specification of 
instructional strategics. 

Selection cues and the use of mnemonic techniques have" always been an 
integral part of Army artillery verbal communications. The TACFIRE system, 
when in a digital mode, converts the traditional verbal messages into visiial 
representations displayed on the TACFIRE CRT. Selection cues, are reflected 
in the message, format but no research has been conducted to establish tlie 
effectiveness oi the present techniques. 

Problem S olving Strategies . The third category includes learner strategi 
associated with problem solving techniques. This category can be further 
broken down into learner strategies associated with problems which fall into 
two major types: closed-system problemsr apd open-system problems. Bartlett 
-(1958) described closed-system problems as ones that, are* formed in such a 
way that all the el^ents for solution are "available and the problem sclvar 
has to fill in the^ appropriate element. In essence, closed-system problems 
are 'characterized by the existence of an identifiable solution and futther, 
progress ^^toward this solution is usually also identif iable. Examples of ^ 
closed-Bystem problems would include anagrams, chess, logic, math problems, 
concept formation, equipment repair (troijbleshooting) , navigational problems, 
etc. 



In open-system problems the problem solver must go beyond the units 
Immediately. given in order to discover a solution. Neither the solutions 
nor the progress' towards solutions are readily identifiable. Examples of 
open-system problems include determining unusual uses for common objects, 
creating cartoon captions and movie titles, inventing a new device or product, 
writing a term paper,* etc; ' , 

-In closed-system problem soOA^ing three distinct approaches have been 
investigated: (1) part is t strategies; (2) wholist strategies; and (3) 
heuristics. Although only limited research has been conducted on each of 
these closed-system problem solving strategies, and research findings on the 
subject are not particularly substantial, there are implications for instruc- 
tional processes associated with each strategy. 

A" good e:^mple of how problem solving is related to team instructional 
strategies is a "brainstorming" session. Members of a "brainstorming" group 
confront open-system problems on a team basis—each individual contributing 
ideas yet building, whole or in part, on the contributions of the other 
members. A Delplii exercise is another example of team open-system problem 
solying. - 

To illustrate team closed-system problem solving, an .excellent example 
can be tak^n from Ar, ; artillery procedures. The most important problem 
faced by artillery ' ersonnel is how to accurately and effectively fire a ^ 

round at a>_. enemy. In order to resolve the problem, a number 'of individuals 

■ t} , 

must coordinate "information and actions. 

Summary . Individual learner strategy categories are made "up of 
comprehension, memory, and problem solving strategies. Comprehension 
strategies relate t the cognitive processes underlying individual learning, 
included are instructional organization, the eifect of question-j, nptetaking. 



rule presentation, presentation of learning objectives, and reading flexibility. 
Memory strategies relate to the entry ^ and retrieval of information from 
short- and long-term storage. Memory strategies include the presentation of 
selection cues, mnemonic techniques, visual imagery, subjective organization, 
memory management, and retrieval. Finally, learner strategies associated 
with problem solving techniques are placed in a third category. These 
strategies may further be grouped as they relate to either closed- or open- 
system problems. 

- The analysis of the literature that is related to learner strategies 
indicates r, ,ia: -. rxumber of strategies have proven effective in the design of ^ 
instructional .^terials. Foremost among these are material organization k^lT 
student interaction (comprehension strategies); the use of selection cues, 
mnemonics, and visual imagery (memory strategies); and training of deductive 
and heuristic techniques (problem solving strategies). Moreover, in most 
instances the strategies would appear to hold for team trainirig environments 
as well as for the individual environments in which they have been investigated. 

Computer-Assisted Instruction -Capabilities 

CAI is a set of programmed components for presenting information," 
providing student interaction,- monitoring student- progress, and oianipulating 
•the sequence of instruction. Instructional strategies encompassing CAI as ^ 
the delivery system are distinct only in thatZthey reflect the functional 
capabi^ties of the hardware and software unique to CAI systems. The prime 
purpose of this subsection is to briefly describe the implications fV cOLT2 
instructional strategies of CAI systems hardware and software and "u. discuss 
how current CAI operational modes are tied to COLT^. 

Hardware_and- Software Capabilities. A prime component of media hardware 
fSr CAI is the presentation device. Several different types of visual 
^. .29 

4.1 



information may be presented depending on the system. In some systems only 
alphanumeric text can be displayed, and in others, it is possible tq represent 
pictorials by graphics. The type and complexity of graphics may also vary. 
For example, still graphics such as diagrams, graphics which have partial 
movement only, or full dynamic graphics similar to animation may each be 
possible depending on the system. Some systems also have the capability to 
present slide or microfiche pictures. Other systems are capable of presenting 
motion pictures through compeer-controlled videotape, as exemplified by 

\ 

TICCIT developed by the MITRE Corporation or the Navy Personnel Research and 
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Development Center's Computer Controlled Multi-Media System (CM)2s, The 
use of split screens or more than one visual presentation monitor is also 
possible, such as the Computer-Based Training System developed by General 
Electric Ordnance Systems or the (CM)2s system. As an example of how the 
presentation media relates to COLT^ strategies, one review of team training 
^(Wagner, et al. , 1976) suggested the possibility of using split screens to 
present information relevant to , the position baing trained, as well as 
information showing the trainee the status of the coordinating position. 

Response devices, as part of the media hardware, also influence which 
instrabtional strategies are possible. Typical response devices include 
standard keyboards, special function keyboards, graphic writing tablets, 
iightpens, touch panels, voice recognition systems,^ device similar to a 
track ball called a mouse, and special adjunct console controls. The choice 
of response device determines thc^ mode of input during the interaction of 
student and system. 

Because of the nature of the presentation and response devices in a 
general purpose CAI system, questions of fidelity and transfer of learning 
for. many tasks involving equipment operator training may arise. It should 
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be recognized that CAI instructional strategies, such as student progress 
diagnosis in real-time, pacing, adaptive instruction, feedback, and optimiza- 
tion, can be included in many real man-machine systems with greater fidelity 
available than on general CAI systems. 

^ Similarly, the computer software available influences instructional 
strategies. Just as the current team training version of^PLANIT can assist 
in developing C0LT2 instructional strategies, we may expect additional 
software capabilities to provide for other strategies. Software cap'abilities 
.required can also be related to computational capabilities, such as those 
used in optimization or adaptiv3 techniques, and control of media hardware 
presentation and response devices. .. 

"^^^^^ 2 presents the names of instructional strategies 
■ found in the literature on CAI. It should be noted that several of these 
names are repeated in the various categorizations of instructional strategies. 
For example, drill and practice and a tutorial CAI are represented in some 
way in most of the lists. Only Hickey^'s (1968) definitions are shown since 
he has summarized most of the others. 

However, while these names are termed instructional strategies, as in 
the case of Hickey, they are probably more properly called modes of CAI in 
that they represent purposes for which CAI may be used in the overall instruc- 
tional design. For example, drill and practice may be used, as described by 
Suppes (1969). to supplement the regular curriculum taught by a teacher. 
The introduction of concepts and new instruction is handled in a conventional 
fashion by the teacher, but the computer takes the role of providing review 
and practice on those concepts and new instruction. While drill and practice 
represents an instructional strategy in part, there are many more details to 
consider. For example, in the Stanford prog;am on mathematics (Suppes. Jerman 
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Table 2. Representative CAI Modes 



Hickey (1968) 

(1) Tutorial; 

(a) Linear: straight line, non- individualized instruction 
.(b) Intrinsic: individualized, branching instruction 
(c) Adaptive: instruction which uses decision-making models to make 

succespive decisions from instructional altei;natives to 

adapt the instruction to the learner 

(2) Socratic: Tutorial but allowing student to assert an answer or solu- 

tion and ask for information. Similar to Suppes Dialogue mode, 

(3) Learner Controlled: Instruction allpwing student to select path of 
' events. '"'^' i ' 

(4) Simulation: Instruction which^.duplicates in the learning situation 

^ th6 format and sequence of' stimulus events in the real world, 

\ 

(5) Game: A form of simulation involving situations of competition or 

•* conflict, 

(6) Testing: Testing is viewed as an instructional strategy by Hickey 

because, with CAI, techniques may be used encompassing branching, 
math models, decision theory, and other decision-making proce- 
dures of CAI, The testing may also be embedded in the CAI as 
an. integral part, \^^y^ 

Suppes (1969) Zinn (1967) 

(1) Drill-and-Practice ' ^ (1) Drill 

(2) Tutorial [ (2) Author Controlled Tutorial 

(3) Dialogue - I (3) Dialogue Tutorial 

1 (4) Simulating and Gaming 

Stolurow (1969) h (5) Retrieval and Reorganization 

(1) Problem Solving A . of Information 

(2) Drill-and-Practice / ^ (6) Problem Solving 

(3) Inquiry / (7) Artistic Design 

(4) Simulation and Gaming / (8) Composition 



^ (5) Tutorial Instruction ^ 



Roagersni967) 

(1) .Drill 

(2) Tutorial 

(3) Conversational 

(4) Simulated Environment 

(5) Simulated Decision 
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and Brian. 1968). an algorithm was developed for determining mastery of 
materials and adapting the drill-to a learner's state. Algorithms of this ■ 
sort can vary and. as they vary, represent differences in the instructional 
strategies. In fact, it is one of the benefits of CAI that such algorithms 
can be performed in real-time with dynamic decision making about the student's 
learning state and the information to be presented. ' 

The point is that the instructional strategies represented in Table 2 
are actually overall purposes which are probably better termed modes. 
Instructional strategies per se are more appropriately considered to be 
combinations of the CAI modes, the media characteristics, the algorithms 
. used as a function of the software available, the components of the instruc- 
tional setting which are adjunct to the computing system, and other factors. 

Finally, while the modes of CAI described above denote the general 
characterization of instructional strategies in a computer-based system. ^ 
they do not specifically delineate the techniques used to achieve the goals 
(direct instruction, drill, etc.). The decisions in specifying C0LT2 
instructional strategies are many and include content, amount and type of 
student control. „:edia selection for presentation and interaction, difficulty 
levels, adjunct materials, and pacing. In short, the decisions are based on 
Information from each of the conceptual framework categories that have been 
established. The distinct advantage of C0LT2 over other instructional \nedia 
f oni^ is CAI can incorporate measurement and computational techniques that 
can more fully integrate these dimensions and allow for more individually 
oriented strategies. 

. The ^measurement techniques used in CAI are in fact part of the instructional 
strategies since many. of the presentation variables, response modes, and 
sequencing techniques, as well as student evaluation, depend heavily on the 
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measuring tej^niques used (Hansen and Johnson, 1971). In adaptive instruction,, 
for example, preliminary measures suc]i ^as scores on personality Scales, 
achievement scales, and aptitude scales may be used in regression^models 

(Rivers, 1972; Suppes, Fletcher and Zanotti^ 1973a, 1973b)'. These\tudent 

' \ 

characteristics, including measures of learner strategies, are also the ' 
basis for many Df the decisions in CAI instructional strategies, both pre- 
instruction and. within instruction. Besides these measures, within instruc- 
tion measures are usually in two forms; (1) the criterion examination, and 
(2) response latencies. Another type of measure sometimes used is error 
rate. Several items of importance for measurement strategies in COLT^ may 
be rioted at this point. First, as pointed out by Faust (1976), very little 
has been done in measuring team learning progress within instruction. / \ 
Usually only a final criterion measure is used to iasure team ef fectiveness'i 
Along these lines also, little has been done to measure specific team task 
dimensions other than communications variables . Secondly, measures of team 
performance do not usually have well-;d^j^ined conditions for the role and 
specific behavior, of each individual in relation to the team goal. 

Summary . The primary CAI capabilities which impact on COLT^ instructional 
strategies may be grouped into hardware and software categories. Hardware 
capabilities essentially reflect' presentation and response devices. In 
turn, the characteristics of both devices are delimiters of the interaction 
between students and system. Software capabilities underlie, the CAI modes 
available to a lesson author^ and, thus, also are a factor to be accounted 
for in the instructional strategy. Examples of CAI modes include drill, 
tutorial, learner controlled, simulation, game, and testing. Further, COLT^ 
Instructional strategies are based in part on the capability of the language 
system to provide coordinating^ functions among team members. 
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A third, consideration in C0Lt2 instructional strategies is the measurement 
technique employed in the CAI. " Many of the presentatiion variables, response 
modes, lesson sequencing, and student manipulation depend heavily on what 
• information in regard tp student characteristics and performance and what 
capability exists to analyze the data. These measures are the basis for ' 
inany C0LT2 instructional strategy decisions, both pre' and .within instruction. 

Implications for Developing Team Instructional Strategies 

As def ined, by Hansen (1970), an instructional strategy is a series of. 
decision points which lead to the sequencing, structuring and specifying oE. ^ 
learning events and activities. Variables such as media choice, content, 
pacing, level of difficulty, and feedback are examples of outputs from the 
decision making. Information underlying these decisions' is based on the 
characteristics of (1) the task to be learned, (2) the learner, and (3) the 
instructional delivery system. In turn, ^team instructional strategies must 
account for the variables representing each of these dimensions within a 
context typically requiring multiperson interactions. The coordinating and 
cooperative behavior present in the job must also be present in the /^raining. 

The first step in developing team instructional strategies is tr identify 
the team tasks. Team tasks are defined by the 'task dimensions previously 
discussed and their parameters set by the task situation (established to 
emergent) and by the intra-team member structure (serial, or parallel) typically 
established for achieving the task. A clear -delineation, of tasks by content, 
situation, and team structure is critical to developing effective team 
instructional strategies. 

Specifically, the team instruct ionaMt.ratigy must represent the job/tasks 
by the team requirements which go beyoiid'th^' individual technical proficiency 
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requirements . For example, ' team operations are enhanced by a thorough 
understanding by each team member of the roles — authority , responsibility , 
and duties—of other team members and how one's own role couples with' the 
roles of other team members. Knowledge of team roles is important when the 
team functions in serial and in parallel and in both established and emergent 
situations. Further, effectivie teams are frequently characterized by compen- 
satory behavior.; that is, one or more team members perform tasks which are 
not typically defined as their responsibility. The bases for compensatory 
behavior are numerous (e.g., individual weakness, situational task overload, 
equipment outages, etc.) . What is critical is that team members recognize 
potential catastrophic situations, make correct judgments as to how they can 
contribute to the correcting of a team "malfunction," and take corrective 
actions. Each of these i^eps is dependent oh team members having the skills 
to evaluate their own as uell as other team members* performance. 

Other facets of knowledge of team roles include error recognition and 
analysis, formulation of i. tra-team feedback, and reception and evaluation 
of feedback messages.^ Jhdii/idual technical proficiency underlies each of 
these facets- VIowever, ttr training focuses on teaching the individual how 
to optimally npply Y:"<n rr '^Is and knowledge within a dynamic team environment. 
In addition to knowledge of team roles, team attitudes and team communication 
are task dimea'sions which mast be addressed by team instructional strategies. 

Second, decisions regarding the structuring and sequencing of learning 
events must i^co^•poratf; attributes > aptitudes, and strategies related to the 
individual learners who will comprise the operational team. Prior research 
on learner characteristics and strategies has primarily dealt with the 
individual learner working on single person tasks. Thus, as a general 
statement, it can be said that farther investigation should center on the 



relationships among such variables,,as team personality complexion, cognitive 
styles, reception preferences, motivation, sex, and prior knowledge as 
factors which effect team information processing, communications, decision 
\iiiaking, .problem solving and task achievement. The desired outcome of a 
program of research would be a model of team composites and learnpr strategies 
--wh-ich-^buld'^^t'^d^with specific team training task requirements. 

In the interest of the present project and current team training efforts, 
those learner characteristics and strategies which appear to hold for team 
training are important. Among these are selected comprehension, memory, 
problem-solving and feedback strategies. The applicability of each to team 
training has been discussed in prior subsections. It seems appropriate, 
however, to provide a synopsis. 

Comprehension strategies are based on the cognitive processes which 
occur during learning. They are manifested in^training through the organiza- 
tion of instructional materials, student interactions, and the types and 
level of materials presented to the student (i.e., objectives, rules, reading 
flexibility, etc.). a/'T . , 

There is no reason to beliesve that comprehension strategies are less 
lii5)ortant to team training than £o individual training. On the .contrary. 
they may be more critical. For example, student interaction strategies are 
primarily concerned with the interface of student and material (e.g., effect 
of questions, notetaklng, instructional prescriptions). In team training 
the student/student interface, as representative of team member interaction. 
Is an added critical dimension. 

Memory strategies relate to the entry and retrieval of information from 
short and long term memory storage. Specific .strategies related to this 
process include the presentation of selection cues, mnemonic techniques, 
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"I visual imagery, subjective organization, memory management and retrieval. As 

■ 1 I ■' ' . ^ ' 

. i stated previously, the first three strategies have the' greatest immediate 

j implications for training and the development of team instructional strategies. 

; . In the development of the brassboard materials, selection cues were used 
, extensively. The cues were based on the priority *and importance of the infor- 
mation presented in terms of task achievement. In addition, a form of mnemonics 
"was employed to represent team communications. Finally, visual imagery was 
stimulated. The project team considered this strategy to be critical to 
rf>tention of the materials (rules) to be learned and to the enhancement of 
learner attitudes and motivation. 

Selected closed-system problem solving strategies are applicable to 
military team training problems and could effectively be represented in 
learning events. For example, TACFIRE operations at the Battalion Fire Direction 
Center require a dynamic interplay of partist and wholist problem solving 
techniques. Partist 'strategies, in the form of reception paradigms, are 
_ appropriate to. the analysis of TACFIRE operational messages. In essence, the 
operator entertains positive instances and selectively scans the message data 
to test and enlarge on the instances. The hypothesis related to actual 
combat conditions is derived. . ' 

Wholist strategies also are integral to tactical problem solving- The 
Fire Direction Officer (FDD) is taught tactical hypotheses covering a broad 
range of combat situations (these hypotheses also are represented in the fire 
plan). As the battlefield scenario unfolds, the FDO constantly checks the 
positive instances (actual occurrences) with his hypotheses to determine his 
tactical decisions. Both partist and wholist strategies are represented in 
the training scenarios developed for the brassboard demonstration/evaluation. 
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Finally.; feedback strategies are proven effective in individual training. 
•The most difficult aspect of implementing comprehensive feedback strategies in 
team training is differentiating individual team merabe^s ' contributions to the, 
, team effort. COLT? offers the pptimum solution to ^this problem as each member 
can be monitored online simultaneously to the total" team evaiuation and feed->^ : 
back. A second major team feedback issue has not been addressed. That is, 
in most team operations > there is a. 'process' paradigm which yields most reliable 
results. Therefore, bothiprocess and product evaluation models need to'be 
•developed in order to more uniformly train to team activities. Such a process 
model, would have the capacity for providing corrective feedback. 

In summary, there are a number of learning strategies which currently 
should be considered as part of the. data base from which team training is 
developed. Notably excepted from this group, however, are personality 
variables, many of which have served as good predictors of performance and as 
a basis for prescriptive instruction. There is little research in this area 
from which conclusions, regarding optional make-up or complexion of teams can 



be drawn. 



Finally, the third dimension of the conceptual frameWorlc foi: devleoping 
team instructional strategies encompasses the instructional delivery system 
or Instructional! ""^^ Present study, the medium was CAI. . The 

C0LT2 instructidnal -strategies accounted for the hardware and software capa- 
bilities/presentj in PONIT and the operating system available. In short, 
instructional stjrategies are delimited by the medium through which the 
learning is to bccur. A detailed description of the potential of the team 
training version of PLANIT is cphtained in the Discussion section. 



: DESIGN AND IMPLEMENTATION OF A TEAK ISD MODEL: BRASSBOARD DEVELOPMENT 
Overview 

In developing the CAI "Brassboard", a team ISD^approa'ch was designed* and 
implemented. The major compontints of the appr6ach included job/task analysis, 
development of team learning objectives, and scenario development inclusive of 
instructional strategies. In turn, each of the components was developed in a 
inanner that reflected the team training concepts and issues that are discussed 
in the previous sections. For example, the job /task .analysis accounts for 
team behaviors required for both an established and enidrgent TACFIRE environ- 
ment as jwell as defining each task in terms of either a -parallel or serial 
operation. Fui^her, the instructional strategies underlying the scenarios are 
based on the team'^sk dimensions, individual learner strategies, and PLANIT 
capabilities. . n 

■ C^^ • . .. ■ 

The followfcg^ subsections discuss the ISD procedures involved in develop- 
ing the brassb.oar^d and^ describe th^ materials developed. ' ^ 

Selection of TACFIRE Functional Area to be Analyzed 

♦ For the task of developing and demonstrating a set of systematic procedures 
for conducting ^ team job/task and training analysis,- representative. samples 
of TACFIRE operations were selected to be analyzed. The following (criterion 



categories were established as the basis for the selection of a TACFIRE func- 
clonal area: , ■ ■ \ - 

(1) As directed in the statement of work, the job/task and training 
analysis inust be conducted for two classes of; team training (a) the man- 
computer-man paradigm, and (b) the man-Cnoncomputer)-man setting. : In selecting 
.an aspect of TACFIRE operations for analysis, these classifications of inter- 
action had to be represented. 
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(2) The second category of selection criteria had as a basis that the 
functions co be analyzed must be representative of critical TACFIRE operations. 
Within this category the following criteria were posited: (a) the function is 
directly related to Ms s ion success; (b) the function is performed frequently;' 
and (c) the function represents a specific block of activities, i.e., has a 

0 

specific beginning, end, and logical continuity throughout. 

The ^second category of criteria was also employed by ART in the selection 
of 'primary -functions for automated individual (AI) training/ In that analysis 
of TACFIRE documentation, operation of - the system, and discussions with TACFIRE 
personnel, ARI concluded that many of the functions performed at the Division 
Artillery Fire Direction Center (DivArty FDC) and the Battalion (Bn) FDC were 
similar. Subsequently, the Bn FDC sphere of operations was selected as the ' 
organizational context for developing AI training. The same sphere of opera- ' 
tions has been identified as appropriate for the team job/task and training 
analysis. The Bn FDC sphere of operations fulfills the second class of selec- 
tion criteria, and there are representations of both man-computer-man. and man- 
nan interactions. ' 

The TACFIRE Bn FDC, is operated essentially by a three man 'team: the 
Fire Direction Officer (FDO) , the Fire Direction Sergeant (FDS) and the Com- 
munication Control Unit pperafor (CCUO)^ The major figures are the FDO and 

' » ^^^^^ 
FDS. In the actual selection of a function area the team- job/task and 

training analysis, a major consideration was that the points of greatest 
interaction between the FDO and the FDS were represented. In fact, an almost 
complete overlap exists between the tasks of the FDO and the FDS in the Bn 
FDC. The responsibility for operations and decision making rests with the 
FDO, but TACFIRE operational knowledge and skills apply to both. These points 
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of interaction have been identified both within the TACFIRE,, documentation and 

previously performed job/task analysis. 

o 

In reviewing the TACFIRE documentation and the functional areas of 
responsibility of the Bn FDC, three primary points of inteiaucion between the 
FDS and the FDO emerged. These three primary, points fell within the Tactical 
and Technical Fire Contjrol Functional area. The firsr point was conduct of a 
fire mission (FM) — processing fire missions, producing firing data, and' 
^recording and reporting fire missions. The second was maintaining and updating 
the data bases that permit tactical and technical fire direction to be accom- 
plished. The third was system operating messages (SYS) used to initialize and 
update the Fire Control Computer files for operation within the FDC and within 
other subscribers, ^ 

For the purpose of the team job/task and training analysis the first of 
these general areas, conduct of a fire mission, was selected for analysis.. 
The content and procedures in conducting a fire mission are a complete entity 
in themselves, as well as a culmination of the application of individual 
learning that has occurred in TACFIRE training. In addition, the conduct of - 
fire missions represents a broad range in complexity for team training tasks. 
Specifically, the analysis focused on three job areas: (1) process FM in 
Autoioatic Mode, (2) process FM in Manual Mode, and (3) process FM received by 
Voice Communication. 

Job /Task Analysis Procedures 

The major questions asked in the^team job/task and training analysis 
were: (1) what does a Bn FDC team look like when operating in an established 
situation? and (2) what changes : in team interactive behaviors may occur in 
specific emergent situations? In order to answer these questions, as much 
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data on team activities and performance was obtained as, possible. The data 
were based on ar. analysis of TACFIRE documentation prepared by the U.S. Army 
Field Artillery School (USAFAS), Ft. Sill, rklahoma, direct observation of 
teams during a Command Post Exercise (CPX) at USAFAS, detailed interviews with 
TACFIRE parsonnel at USAFAS, and a survey of TACFIRE instructors. 

A detailed team job/task and training analysis was made of the Bn FDC 
team functions. This analysis included a description of each act carried out 
by team members and the sequencing of the acts. Every act of team members was 
broken down into three oelements ; input , the signal or stimuli that elicits = 
the behavior; process, the response; and output , the signals or stimuli 
resulting from the process. Each act was then linked to subsequent acts as 
either a man-man interaction or a man-machine-man interaction. In this way it 
jras possible to set up a team task ^ low for the established situation. Figure 
(^1 is a segment extracted from a team task flow chart. 

• The man-machine-man interaction is representative of two' types of machines, 

the radio and the computer, and of two types of machine mediation. The first 
type of machine mediation requires only that the machine be a. vehicle for 
. transmitting data from one point to another. The radio always performs this 
typj? of function; the computer frequently doer.. The second type of machine 
mediation requires that the machine perform a function wl> "ch before its intro- 
duction was perffmed by man or a different, and pi^obably i less sophisticated, 
. machine. The function may be, for example, a calcil^ion, record keeping, a 
check of procedures, or eveA the making of a decision. ) Only the computer, 
with its associated peripherals, can perform these funitioas. Thus,, in the 
job/task flow charts the types of system programs -f^^. , TTFC and AFU) used 
for data analysis and manipulation by the computer are identified as well as 

' if the machine mediation is solely fot the data transmittal. 
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Figure 1. Excerpt from Job/Task Flov Chart of Fire Mission 
Processed in Automatic Mode, o 
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Af',er completing the job/task flow charts^ a task/subtask summary table 
was developed for each mode of processing a fire mission (see Table. 3) . .The 
t^.sK/ subtask summary tables represent major tasks and subtasks which comprise 
a fire mission. Th^s, the table identifies what tasks are exercised in each 
mode of processing a firp mission and provides the following information: 

(1) Team member involvement, 

(2) Type of team structure (serial or parallel) , 

(3) Class of interface (man-man or man-machine-man) , and 

(4) Task (training) dimensions. 

The laFt category includes the task dimensions making up the learning 
categories discusse'd, previously. Two dimensions had to be reclassified. 
Probabilistic structure as a communication dimension was changed to infoma- 
tion prompting. This dimension included messages which cue other team members 
that their attention and action are required. Second, the communication 
dimension of evaluative interchange was called information interchange and 
denoted the reception and transmission of messages containing mission related 
information. An example of the former would be the message 'Fire Mission' - 
alerting all team members to be ready. An example of the latter would be a ' 
me.c.sage from the FDS to the FDO stating that "Charlie battery has jast run out 
of ammunition." .The other communication dimensions remain the same. 

In -turn, emergent situations were identified at each point of team member 
interaction and possible reactions to contingencies were specified. The range 
of possible solutions to contingent problems served as the basis' for develop- 
ing emergent team-f raining objectives as well as Identifying critical training 



nodes. 



45 

57 



Table 3, Example Smary Table of Team Characteristics for a 
Fire Mission Processed in the Automatic Mode. 
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Involvement 




1.0 Process Initial Fire Request 
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5,0 Process EOM and MFR 
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5.3 Take Computer Action 
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Development of Team Training Objectives 

The team training objectives were organized by task and sub task. Criterion 
objectives reflect the condition and behaviors underlying the team achievement 
of a task., Enabling objectives reflect the necessary sub task behaviors of 
team members which, collectively, result in the accomplishment of the task. 

In deriving the enabling objectives, each subtask was examined in terms 
of the team task dimensions. If the presence of a team task dimension within 
a given subtask" element was established, then an enabling objective was 
developed to represent that dimension. Thus, each subtask element was reviewed 
within the learning category/tatsk dimension framework constructed during Task 
1. Table 4 presents a sample of team training objectives. , . ^ 

Scenario Development 

The major objective i i creating the COLT^ scenarios was to develop a team 
training vehicle rather than simply a multiperson drill and practice sequence. 
As a training vehicle, the scenario had to be capable of incorporating instruc- 
tional strategies reflecting the tasks and tactical situation^, addressing 
individual learner requirements, and providing for the computer -management of 
all facets of the instruction including student responses. Thus, the scenarios 
had to be structured to ensure flexibility at the decision points for manipulate 

ing training resources in order to maximize performance and minimize training 

• . * ' - 

time. With this objective stated, two basic assumptions were made: 

'1. Team training scenarios are task and environment specific in nature. 

For weapon system training, the scenario must represent team member roles, 

information flow, decision points, problem solving requirements, coordination 

activities, ..operational doctrine, , and tactical evolutions. 

. * ' * ■ " ' 
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Table 4. Example of Fire Mission Team Objectives. 



TEAM TASK 
DIMENSION 


CRITERION OBJECTIVES 

* 


ENABLING OBJECTIVES 


Sonfldence 


Team pcnbera of the Bn FDC will indicate 
their trust in the ability of other members 
and the TACFIR2 conputer to perform a fire 
mission In a timely and correct manner as 
o|/d.AL^cu Ml tT^vRni^'Oi manuam tor iAUfiKLi 


For each of the tasks and subtask elements 
identified in tables 3, 5, and 7, the team 
members Involved will indicate their trust 
in the other members and the TACFIRE com- 
puter to perform in a timely and correct- 
manner as specified in technical manuals- 
for TACFIRE. 


•• 


4 


Applies ^ 
to each 
; enabling 
objective 

d 


These objectives apply to tasks 
lfO-6.0, including each subtask elemeni 
j as applicable for both automatic and 
manual modes. Conditions of the 
objective Include the member Involve- 
ment^ team structure, and class of. 
interface defined on tables 3, 5, and 


Egress iveness 


Team memberi of the Bn FDC will indicate 
willingness to initiate actions, communi- 
cations, and procedures during a fire 
mission when the timeliness and correct 
performance, of the inission require it. 
Initiative will be indicated as; being ' 
within the bounds of team member roles. 


X 

For 'each of the tasks and subtask elements r 
. identified in tables 3, 5, and 7 the team 
members' involved will Indicate wllllngneas 
to initiate actions, communications , and v 
procedures when the timeliness and correct 
performance of the mission require it. 



• -2. The critical factors In a scenario-driven team training process 
include perception and expectation about .jobs, coordinated and compensating 
task/team member interaction, and the priorities of mission events. 

The emphases underlying both assumptions are twofold. First, there must 
be adequate incorporation of team'member interactions in the instructional 

must be placed in a siaulated tactical environment. It is believed that rich 
combat representations built into tlie scenarios are critical to the involve- " 
ment of the trainee at more than a drill and practice level. The following 
subsections on scenario sequencing and scenario structure will address the" 
issues in more detail. 

Scenario Sequencings 

In order to match the entry level and projectac' ccumulative learning of 
the subjects with the variety of team interactions present in a continuum of 
tactical- combat situations, it was necessary to develop the scope and sequence 
of. scenario presentations- In essence, this translated into four levels of 
training for the demonstration/evaluation. These levels were (1) individual 
training, (2) beginning team training, (3) Integrated team training, and (4) 
emergent team ttaining. The scope and Sequence reflected both the theoretical 
anderpinning as well as the implementation of the team ISD model. That is, it 
was recognized in the literature that a certain level of individual competence 
had to be attained before the students could effectively be trained as team 
members. Secondly,- the team ISD model is in part based on the assertion that 
both established and emergent situations which reflect the actuality of the 
team. operational situation must be maintained in the training scenario. The. 
scope of each scenario within the training progression incorporates- ir.ereasing 
complexity in regard to team member roles, information flows', deci&±«jand 
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problem solving requirements/ coordination activities and tactical evolutions. 
The foll^ing paragraphs discuss each level of the scenario presentation. 

Individual Training . As stated in the above paragraph, the project team 
assumed that a minimum level of individual competence must, be achieved before . 
'•"Ceaffi" training' Cdn be'^ The first instructional sequence 

was designed to thl^ objective. The lesson included lecture/tiiscussion-sesrslons ^ 
and an individually^oriented CAI scenario. The lecture/discussion aspect of 
the instruction centered on teaching the basic operational doctrine, rules, 
and guidelines to be followed by the students throughout the team instructional 
sequences. Student handouts included basic definitions and explanations of 
the oper^tions^in which they vould be involved, maps and statements of the 
rules with which they would have to comply to correctly respond to various 
learning events. This pre-CAI instructional event occupied approximately 20 
minutes of the demonstration/evaluation session. Upon completion of that 
8e^l<5n, the students were introduced to the first CAI lesson. This lesson 
covered the rules, regulations, and procedures for conducting a TACFIRE fire 
mission. CAI instructional strategies included drill and practice- to criterion 
levels, tutorials, individual feedback, and a debriefing session for those 
subjects selected to function as a team. 

Beginning -Team Training . The second sequence of scenarios comprised the 
beginning team lesson. This lesson Introduced the subjects, for the first 
time, to coordinated sequence drills. In addition, problem complexity routines 
increased by number of missions, target spread. Information flows (Including 
erroneous information) and team problem solving activities. The COLT^ strategies 
for the beginning team lesson also included individual feedback as well as . 
team 'debriefing Again, the beginning team training essentially was doctrine 
training' on TACFIRE operations, focusing on the established team roles. 
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Integrated Team Training. The third level of scenarios represented 
integrated team training. The integrated team training scenarios were originally 
designed to incorporate instructional strategies which related to coordination 
and compensatory interactions. That is, the team members were to be presented 
with multiple tasks which were, to be integrated through specific decision 
=-I>rocessiiig.whixh-would=lead-to-i:h-e-anTO^^^ This instruc- 

tional sequence was to represent the multiple mission and task operations 
which in actuality characterize art'illery operations. Thus, the team would 
have to demonstrate both individual and team coordinated (compensatory) 
behaviors throughout the lesson. The decisions base would be dynamic, pri- 
marily based on individual performances and mission-task priorities. The 
operational conditions for the integrated team training scenario (e.g., equip- " 
ment, personnel, logistics, etc.) were presented in a favorable tactical 
evolution. 

However, the difficulty of programming PLANIT to handle the complex 
branching and communications required precluded the full implementation of 
this scenario. In actuality, the scenario was more individually oriented, 
characterized by multiple task presentations. 

Emergent Team Training. The final sequence of scenarios was for emergent 
team training. These scenarios were designed to incorporate all instructional 
strategies previously employed^-specif ically emphasizing those of major com- 
plexity within the integrated team training scenarios. Further, the instruc- 
tional strategies would incorporate operational fluctuations (positive and 
negative) and combat catastrophes. Again, however, the development of the 
scenarios was limited by the time frame for dealing with subjects and the • 
capability' of PLANIT to handle the complex switching, branching, review and 
communications required for intrateam manipulation of the tasks. 
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The actual instructional sequence prepared for the subjects included the 
. presentation of a series of four tactical situations in which decisions were 
required regarding the assignment of member roles and the structuring of the 
team; After the decision points were passed, a series of questions related to 
'team^ Tnember^ttitrudes- about the operation were asked of both team members • 
Then the team members received an evaluation and assessment of the decision, 
with hypothetical performance outcomes. 

Scenario Structure 

The scenario structure for each training level was similar. Basically, 
each sequence started with a description of the tactical situation. This 
included all relevant information necessary for the FDC team to effectively 
conduct a fire mission. Second, the tasks requiring student execution were 
presented. Third, there was a phaseout which presented the subjects with a 
synopsis of the effects of the fire missions that they had conducted. Finally, 
for each of the subject teams thejre was a debriefing session. This session 
Included a discussion of the individual performances throughout the fire 
miissiori and an assessment of the overall team performance. In turn, subjects 
were allowed to discuss tfheir own role interactions and to discuss any team 
problem solyiiig strategies they may implement in future lessons. 

PLANIT Implementation* 

A primary objective of this investigation was to assess the applicability, 
and potential of the PLANIT system for C0LT2, Under the aegis of ARI PLANIT 
has been modified by Dr. Charles H. Frye of the Northwest Regional Educational 
Laboratory to support team training. The team extension of PLANIT was based 



*For the demom -ration, PLANIT was installed onARI's CDC 3300. The installation 
used 84K bytes of core memoiy. The remaining program was divided into 18 par- 
titions; thus, very heavy swapping of overlays resulted when using DIAL. CALC, 
and the common matrix. x 
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on a logical derivation of possible language requirements for neci i training 
without the benefit of an experience of actual implementation attempts. The 
present study offered the first opportunity for determining the aac.quacy of 
this initial PLANIT team training version. 

The team training directives implemented in PLANIT and used in the lesson 
developmen't of this study were: (1) a common lesson matrix that could be 
defined/ retrieved or updated (the FETCH and PUT directives, already a part of 
PLANIT, are used to manipulate the common matrix) , and (2) use of the DIAL 
directive while in the CALC mode or as a CALC command in the lesson scenario. 
Four team training CAI. considerations are tied to these directives. They are: 
(1) storage and retri^vsil of information related to scenario events, communi- 
cations, learning events g^qu ences , and student performance via the common 
data base, (2) initialization of lessons, (3) synchronization of team members 
to scenario events, and (4) communications among team members." The remainder 
of this subsection discusses each of these major considerations and how they 
were implemented in the lessons via the PLANIT directives. 

r 

' Common Data Base > The common data- base in PLANIT was adequate for 
implementation of the instructional strategies, for the tracking of events, 
event sequencing, and synchronization of subjects. 

The use of the common data base' for these purposes involves, only a matter 
of appropriate design of the matrix in PKANIT. However, if the team training 
lessons of the future are to be implemented by Army instructional personnel 
for example, then it may be desirable to provide commands with parameters to 
set the values of a common data base indicating sequences of events, automatic 
designation.. o£ terminal values, and synchronization requirements. 

Initialization ^ The problem of initializing a common lesson base for 
multiple students has been addressed in the team version of PLANIT. Frye 
(1976) describes the procedures -required. 
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FRAI1E l.DD {]» 



GE. CRITERIA 

C:SET nATRIX{XnED> C:SET X{1}=TERI1INAL C:PUT X 
F:(?TYPE 'HI'TO CONNECT UITH THE OTHER PLAYER. 



FRAME E-DD {(2} 

G3^,AMMERS 

A HI 



FRAflE 3. DO {I» . 

GE. CRITERIA 
C:FETCH X 

IF X{1} ElJ tERHINAL 

F: NOT THERE YET. UAIT A IIINUTE AND TRY AGAIN. B:E 
ELSE C:SET HldXIl} C : XtlJTERdlNAL C:X<E}=TII1E dPUT X 
CrPRINT 'OK. YOU ARE LINKED UITH TERMINAL =iHII1 ROUNI>{0}' 
IF TERMINAL IS HIM C:SET MINE=3 C:SET HIS=M 
ELSE C:SET MINE=M C:SET HIS=3 



In the above example, the two players will be connected to 
the team scenario by both GETting the same lesson name. / 
Beginning with the third statement in frame three, the logic 
is set up such that the most recently answering terminal 
will be identified by nuvcber in the^ first common entry, and 
the time of the answer in the second entry. The item HIM 
will be the terminal number of the other player and can be 
used in the DIAL comdpnd, e.g. : 

DIAL HIM YOU AND I ARE NOU TEAMED.. 

The third add fourth entries of the common area are set up 
for communicating code values, and the items, MINE and HIS 
are defined properly so that separate entries will be 
assigned. MINE and HIS woiild be usfe^^ frequently to. subscript' 
the matrix X after a FETCH or between a FETCH/PUT update 
sequence. 

The next example will perform the initial acquisition for 
three team members. This logic can be extended to as many 
members as desired. Having acquired all members, of the 
team, a branch is made to another lesson where each team 
ieinber will be in a different lesson. The common lesson 
matrix will be valid for all three lessons. Each lesson 
will then proceed according to the role of that particular 
team member: 
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FRAME l.DD {]>.> . ' 

62. CRITERIA 

C:SET nATRIX{X-,2D> " , • 

IF LINK{1D> N(3 0 dPUT X C^LINK{1D>=D ' 
ELSE C:LINK{1D>=1 C:FETCH X C:LINK{1D>=D 
IF X{1> Nfl 0 F0R{I=l-,3> 

F: SORRY -.ALL POSITIONS ARE TAKEN- ANOTHER TIME- C:FINISHED 
ELSE FtQARE YOU RED-, YELLOU OR BLUE? 



FRAME H.DD {(2> • - 

G3. answers'^ 

} KEyUORD ON , 

A RED 

B YELLOul 

C BLUE 

G^. ACTION-S 

A C:SET COLOR=J^ . . 

B C:SET C0L0R=2 - . 

C C:SET C0L0R=3 

- R:ANSUER ONE OF THE THREE OR TYPE' ' FINISHED . ' 



FRAI1E 3.00 -CD} . ^ 

G2. CRITERIA 

IF X{COLOR>) Nia 0 F: SORRY-, lilE HAVE ONE OF THOSE ALREADY. 
F:CH00SE another. B:2 

ELSE C:FETCH X C : X{Ci5L0R>=TERniNAL C : X-Cl'=3>=TERniNAL 
C:X{2D>=TinE; C:PUT ,X B:S 



FRAHE ^.D□ {C3> 
G2. TEXT- 

DON'T HAVE ALL. THE" PLAYERS YET. TYPE 'GO' AND I'LL 
CHECK AGAIN. 

G3. ANSWERS " 

A GO . ■ ^ 



FRAME S.QD {,p> 

G2. CRITERIA " * „ . ' 

C • F E T C H X ^ 

IF PROD X{I> F0R{I = l-,3> Efl 0. B:4 • 

ELSE F^OK-, LET'S GO. B:RED-, YELLOU-, BLUE: COLOR 
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In this example,, the first entry of common has the terminal 
number of RED, "the second has YELLOW, and the third has 
BLUE. The 19th entry shows the number of the most. recent 
terminal to 'answer and the 20th entry shows the time of the 
answer.; Finallyi a branch is made to one of the three 
lessons^ each of which presumably contains logic that per- 
tains to a particular player. 

Synchronization , During team training interactions^ it is frequently 
necessary to determine where each individual student is in the sequence, and, 
depending on the instructional sequencing design, it may be desirable to stop 
a student at some point while another team. member catches up or performs 
another action which will influence or be dependent upon another team member. 
Thus, two c important -aspects of synchronization are derived. First, it is 
necessary to test for the occurrence of events or team member status in the 
instructional sequence. Second, it is necessary at times to hold a team 
member in place. In both cases, student progress (events) must be tested in 
drder to properly sequence member interactions. Several ways of testing for 
events can be illustrated with examples from the lesson implemented for the 
demonstration and from examples extracted from Frye (1976) . ^ 
\ Further, the initializaeion examples previously presented also showed 
instances of synchronous operations since no player is allowed to proceed 
u/til all have signed into the system. Another example of synchronization, 
provided by Frye, follows. . In this case no one is allowed to proceed beyond 
frame 10 until all are together. - 

FRAME a. □□'{»> 

6E. CRITERIA - 

C:FETCH X C:X{C0L0R+1D>=1D C:PUT X 

F:THERE may BE A SHORT DELAY- UNTIL EVERYONE CATCHES UP. 
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C:FETCH X 

IFX{I} E(3 10 F0R{I = llil3} B:ll 



FRAME 10. □□ {(3> 

GE. TEXT 
TYPE 'GO' 

G3. ANTUERS 
A GO 

G^. ACTIONS 

FJOK-, UILL CHECK B:T " 



In the 'brassboard' , students interactt i with the system and each other 
to simulate the sequence of events comprising a fire mission. Frequently, the 
FDO was required to take an action; the FDS evaluated that action; the FDS 
then was required to take an action himself. This required holding the FDS in 
place until the FDO had taken an action and the FDS had received a communication 
from the FDO stating what the action was. 

For example, a series of frames of the sort below wrs presented. Each 

■ ■ ■ ^ 

required the above described sequence of responses by the FDO and FDS. 



FIRE MISSION 

RED THUNDER 13 - THIS IS UILD HORSE 
b - FIRE MISSION. INFANTRY PLATOON IN 
THE OPEN-, UILL ADJUST FIRE. 

TGT .NO. ^S INFANTRY].. 

TAKE ACTION , 

1- PAGE " ^. CORRECT 

E. FIRE S. PROBLEM 

3. CLEAR 



Each frame was seen by both team members. The FDO answered first, and his 
action was communicated tc the FDS. However, his message could be transmitted 
only after the FDS had received the complete display as shown. Furthermore, 
the FDS could be allowed to respond only after receiving the FDO' s message. 
The lesson sequence to control this synchronization was as follows: 
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— F:?AnE— S.OD {!>> L.*BEL=READY 

6R0UP 2 

5.:FErCH C': Xtl •. 1 •. 1>=RESP0NSE C: X{3-.3-.l} = X{3-.3-,l} + l C:PUT X 
_ IF X{3-,3-.l} LS S{3-.3-.2> BiSYNC {X{3-.3il} . 
IF X{I.3-.l} Efl X{3-.3-.?} B:fl 
ELSE F-:|* 



FRAME b.DD -Cfl} 

GROUP 3 i 

0 WAIT- S . 

A AZS 

GROUP M 

-A F: STANDBY 

V 

' FRAHE 7. 00 {DJv 
GROUP 2 r - ' 

C:FETCH X / 

IF X{l-.M-.2} ZQ 0 F:YOUR TEAHHATE IS GONE. B:^.S 
IF X{3-,3.1> GR X{3-,3-,2} F:|$ B:b 



FRAHE a.DD ' ' 

"CANNED MESSAcff FRAME" - to be described in following subsection. 

FRAHE a.lQ • , 

GROUP 2 ^ , 

B;SYNC{X{3-.3-.l}} 

■ r 

FRAnr ^.DD {fl} 
GROUP 2 ~ 

FIRE niSSIOIJ 

RED TKUNDEK 13 - THIS IS UILD HORSEt.^- 
FIRE MISSION. INFANTRY PLATOON IN THE 
OPEN-, UILL AD'JUST FIRE- 

TGT., NO. IS INFANTRY 1. 

TAKE ACTION 

1. PAGE 4. CORRECT 

2. FIRE S. PROBLEM 

3. CLE-AR 

GROUP- 3 • 

I+l- ^ ' ^ . 

2 M UITHIN 2 
GROUP M • . 

1 F: YOUR ANSUER IS RIGHT -- EVERYTIME 

F: YOU RECEIVE THE FM NOTIFICATION YOU 'PAGF' 
F: TO CHECK FOR A WARNING. B:READY 

2 F: THE CORRECT RESPONSE IS 'PAGE'. YOU 
F: 1UST 'PAGE' THROUGH THE MESSAGE TO 
F: CHECK ("OR A WARNING. B:READY 

R: CHOOSE A NUMBER FROM THE LIST 

>> . ■ - 
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_^__-I.t---8hould be noted that in this sequence (part of the FDO's lesson at the 
beginning team level) a branch to the--fxame labeled "READY" is -made after a 
legitimate response. READY is frame number 5.00. -Its major purpose is. to 
increment a counter scored in the common matrix for tracking the FDO's position 
in the lesson and comparing it to the EDS' lesson position. Cell 3,3,1 in matrix 
X served this purpose for the FDO. Cell 3,3,2 was used for tracking the EDS, 
and a similar frame sequence existed -in the EDS lesson. In frame 5.00, if the 
EDO and FDS had been at the same point in the lesson, a branch to frame 8 
would have been made to transmit a canned message. Frame 8.1 was then executed 
to a branch to. the frame number in an array "SYNC!' designated by the value of 

c 

3,3,1. If the value of 3,3,1 was less than 3,3,2, the FDS had already be^ 
sent the message^ and a similar branch could be made through the array SYNC to 
allow presentation of the next frame to the FDO. If neither of these two 
conditions were true (3,3,1 was greater than 3,3,7.) the FDS wa- behind the TOO 
and not ready to receive the message. In this case, frame 6.0 would be 
executed to inform the FDO to standby. Frames 6.00 and 7.00 form a standby ^ 
loop to hold the FDO until the FDS could get* into proper lesson position. 

' Communications. Two forms of communicating between team members are 
available in the team version of PLANIT. The DIAL directive is "used for both 
forms. First, team members may use DIAI. to initiate, compose, and exchange 
messages at the terminal. Second, messages can be written .into the lesson. 
Having assigned terminal members to variable CALC.tiames, targets of the 
'canned' messages can be designated in the scenario. The recipient of the 
message will see the sender's name as. part of the mess,a'ge. However, the 
sender would not know that he is transmitting message unless he is told. 

For the COLT^ lessons, four aspects, of conamunicaLtions were important: 
(Decontrol, (2) content. (3) timing; and (4) recording. Control relates to 
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which team members initiate messages and which receive messages . Content is 
the subject of the message. Timing relates to when messages are sent; 
Recording of messages relates to the storing of the above three for evaluative 
purposes. If the terminal oriented DIAL directive had been utilized, none of 
t^iese ^uj?^ aspects would have to be controlled. For this initial investigation 
into C0LjC2, it was dJsirable to have a capability for directing and storing 

I 

communications. Theretore, the DIAL messages were written into the lessons. 

A series of five, messages representing the array of possible FDO responses 
at a decision point were coded into the lesson. The message to be transmitted 
to depended on the decision made by the FDO. An example of the message frame 
follows: * 



FRAHE fl.OO {P} 

GROUP E ■ • ' 

B:iii-,nE-.n3-.nM-.ns-.x{i-,i.i} 

ni:l>IAL FDST I THINK 'PAGE' IS THE RIGHT ANSUER. B:TAIL 
nE:i>iAL FDST I THINK 'FIRE' IS THE RIGHT ANSWER. B:TAIL 
n3:l>IAL FDST I THINK 'CLEAR' IS THE RIGHT ANSWER - B : TAIL 
nM:DIAL FDST I THINK 'CORRECT' IS THE RIGHT ANSWER. B:TAIL 
nS: DIAL FDST I DO NOT KNOW RIGHT ACTION-. YOU CHOOSE. 
TAIL: 



Prior to reaching this frame in the lesson, the value of cell 1,1,1 in 
the common matrix was set to a value determining which message (Ml, M2, M3, 
M4, M5) was to be sent to the FDS terminal (FDST) by the FDO. The event value 
determining the message in this case was the action, selected by number, to be 
taken in the fire mission. X(l,l,l) was therefore set to the value of the 
PLANIT primitive response. The conditional brar-cU statement in line 1 Group 
2, Frame 8, above therefore selects the message to be sent to the FDS appropri- 
ate to the FDO' s action. This capability of PLAirIT to select the particular 
message is prot ibly adequate for most purposes where the message sequences are 



pre-prepared as part of the lesson data base. 
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BRASSBOARD DEMONSTRATION/EVALUATION 

The purpose of the brassboard demonstration/evaluation was twofold. 
First, an assessment of the instructional strategies sampled in the scenario 
was accomplished. The output of this aspect of the study is (1) a^report of 
the -findings, and (2) research recommenda'-ions for instructional strategy, 
scenario, andijob/task analysis issues which remain unaddressed. The second 
function served by the "pilot study" was the assessment of the applicability 
of the PLANIT language for team training. The output of this facet of the 
study is a set of recommendations for PLANIT language extensions necessary for 
a full team training capability. The remainder of this section will contain a 
description of the brassboard demonstration/evaluation implementation pro- 
cedures arid the findings of the study. The following section provides a more 
detailed discussion of the implications of the findings. 

Subjects 

The subjects were 40 Army enlisted men from commands in the Washington 
area. The ranks of the subjects ranged from E-3 to E-7, with more than 75 
percent of the subjects, being E-4's or E-5's. A variety of military occupa- 
tional specialties (MOS) were repfesented. However, a majority of subject 
MOS's were related to administrative and clerical jobs, fable 5 presents a 
summary of other characteristics of the subjects. ' . 



61 

74 



Table 5. Summary of Subject Characteristics 



Variable 


Mean 


S.D. 


Age 


25.3 


4.C. 


Years in. Service 


5.3 


4.2 


Educational Level 


13.0 (years) 


1,4 


GT 


, 114.8 


11.4 


■ . - " " 



The demonstration/evaluation was conducted in four steps. During the 
initial step, subject biographical data was collected, and two individual 
difference scales were administered. These scales were the .:c:r.t .r Seal-" 
(Rotter, 1966) for assessing locus^pf control and the A-Trait ^ecul.-n of the 
State-Trait Anxiety Inventory (Spielberger , Gorsuch and U .htiu-se, After 
completing ..these scales, students were assigned to work th ough tm uibsequent 
instructional materials on either a team or an individual . visi r' . ais assign- 
ment was conducted on a random basis. Additionally, team n- : cs were assigned 
roles; that is, they were selected to undergo the instructiou either as a fire 
direction officer or as a fire direction sergeant. Again, the assignment of 
roles was conducted on a rsr^doit basis. 

;-?:ep 2 involved preiienting the subjects with pre limii^ary background 
information re,garding subsequent tasks that they* would be performing. Pri- 
mar'CLy, this ItiUfon tavi(^t:r. the subjects how to; conduct the basic fire, mission. 
The instruction was lee r-are/-dis cuss. -.vm with students having handouts and 
exerciser to work Uiirough. Upoiv completion of this phase of Step 2, the 
subjects were incroducec? to their first computer-assisted instruction lessc^. 
The first lt«sson vas ind^ ^'Idually based, with all subjects going through 
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identical information sequences with no coordinated (team) activities required. 
At the conclusion of this lesson, the subjects took a 15 ir.env test presented by 
the computer. 

After subjects had been familiarized w.ith the procedures for conducting a 
fire mission, the team began work on their first coordin^itec^ instructional 
task. The iJ^feic team task requirements were identical for -^21 teams and 
consisted of sequences of increasingly complex fire misslOvVi. The suhletts 
operating in an individual mode were >>resented with the same materi,>J.p that 
were presented to the teams. However, subjects were not. requi/;od t^,^ coordinate 
their activities with another team member. There were 39 stude- !r <r:X3cutions 
(decisions) required in this lesson. At each execution point, 55abjects were 
required to iiiake a procedural response within a tactical fire mission context. 
Dttring the lesson individual feedback was presented <:r. rAi subjects. At the 
conclusion, 'the teams were debriefed and allowed c.c? dj^cuss role assignments 
and team interactions. 

Step 3 focvised on the integr^ited team lessons. As stated in the prior 
section, the integrated team materials; were net presented to the subjects in 
the tjianner in which originally designed because the software limitations. 
Originally , the integrated team lesson was to confront the team leader and the 
other tesK ixxember with a continuum of tactical role assignment decisions. 
After each decision,. to be made either individually by the team leader or in 
concert with his fellow team member, specific tasks had to be performed by the 
team members. At the conclusion of each set of tasks, a new tactical situation 
would ari&e where multiple tasks again would have to be integrated and team 
resources allocated. In actuality, the lessons did not include the decision 
anakias properties. Thei;e were a combination of tasks to be performed, but 
events were sequenced by the lesson rather than the learner. Tlie only difference 
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in strategies between the* tekm and individual subjects was the fact that at 
certain points throughout the instruction, the teams were coordinated and did 
receive team feedback on performance • 

The last phase consisted of the emergent team lessons.' Tlje materials 
were presented as described in the prior section. Primarily, they constituted 
a series of tactical situations in which specific artillery fire mission 
problems were presented. At each of these decision points, both the FDO and 
FDS were allowed to respond as to what action they would take to resolve the 
problem. In the team environment, however, the decision made by the FDO was 
the one that counted. After each decision was made, both team and individua;L 
subjects were presented with a series of questions relating to their confidence 
in the decision, role assignment, and projected team performance. 

At all steps drill, problem complexity in sequencing, and feedback strate- 
gies were similar. The teams, however, were working through coordinated 
sequence drills; whereas, individuals were. not. Another major difference was 
that team debriefings were more extensive, with team members being apprised of 
each other's scores and having the opportunity to discuss future role assign- 
ments. 

Measures 

Basically, three categories of measures were collected: (1) entry 
behaviors, (2) performance ratings, and (3) attitudes. Entry behaviors 
included the variables of age, years in service, educational level, GT, mili- 
tary occupational speciality; rank, stress anxiety, and locus of control. 

Locus of control was assessed by means of the Rotter I-E scale. Locus of 
control is a theoretical construct that refers to the degree to which individuals 
believe that reinforcement is either directly contingent upon their own behaviors 
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or. independent of them anf attributable, mostly, to .chance 
belief is ascribed_to people at the internal end of the locus of control 
continuum and indicated by low scores on the Rotter I-E scale. Individuals 
with high scores are at the external end of the locus of control continuum. 

There were two reasons for selecting locus of control as an individual 
difference variable in th6 present research. First, the available evidence 
indicates that locus of control is sufficiep«4^consistent and powerfu/in its 
effects upon behavior to justify its use as a basis for selection of team 
members. Second, although research findings regard. the influences of locus of 
control on classroom behavior and achievement as equivocal, where significant 
differences have been attained, higher achievement generally tends to be 
positively correlat,:d to an internal orientation, particularly under learner 
control methods. (Daniels and Stevens. 1976; Nord. Connelly and Daignault. 1974), 
Considering that the instructional task" investigated in this study is computer 
based and has a potential for allowing students an extensive amount of individual 
control, it ..was reasoned that locus of control could serve as a meaningful 
predictor of task achievement. 

The second individual difference scale employed in this study was the 
trait anxiety scale developed by Spielberger. The state-trait anxiety theory 
as formulated by Spielberger (1966) emphasizes the practical and theoretical 
importance of differentiating between anxiety as a relatively stable, generalized 
personality trait and as a situationally dependent state or condition that 
varies in intensity over time. The subsequent development of the state-trait 
Inventory (Spielberger. et al. . 1970) was intended to establish a means for 
characterizing individuals in terms of both dimensions. These types of findings 
have def ini.te value from the standpoint of allowing one to forecast with 
reasonable accuracy how students tend to react to stressful stimuli over time 
in 'a variety of situations. 
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^^===^Gn-the^basis:-of^the-.previous reseaM following judgments were made 



concerning t.ie role of anxiety variables in the present investigation. 

1. The available literature on anxiety provides a strong empirical and 
theoretical rationale for using a trait anxiety , variable as a basis f6):-.^ir^ 



dieting student performance under differing modes of instruction (e*g.,^^^am 
V8« individual). ^ 

2. With regard to the use of trait anxitty as . a predictor variable, it- 
was assumed that some students would find the coordinated structural activities 
significantly more stressful than would others. Anxiety theories suggest that, 
the probable consequences of such reactions would be greater distractibility 
during acquisition and lower performance on the final test. It was therefore 
reasoned that anxiety variables would provide a useful basis for selecting and 
refining instructional strategies, particularly given team and individual 
instructional sequencing. 

Performance Measures . Within each instructional lesson, performance 
scores were collected. At the' conclusion of the individual lesson, there was 
a 15 item quiz. During the beginning team lesson, there were 39 decision 
points with student response data being collected at each point. Student 
performance on the integrated lesson was evaluated at decision points within 
fire missions and by a second criterion quiz of 10 items. Finally, in the 
emergent team lesson, there were four decision points about which student 
responses. were collected. Response time was kept, but it was more a measure 
of machine response time than student reaction. 

Attitude Measures . Attitude measures were collected only during the 
integrated team lesson. These took the form of seven confidence and role 
assignment rc ated items which were administered subsequent to each tactical 
-declsion^being made. 
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Findings 

Means. and standard deviations for subject characteristics, individual 
difference scales, and performance scores are presented in Table 6 by total 
group, tekm FDO, team FDS, and the individual instruction subjects (IND) . 
Although the subjects were randomly assigned to groups there were significant 
differences between groups in regard to' some variables. The FDO group had 
approximately one-half year more of education (X = 13.31) than did the FDS 
group (X = 12.-75) and the IND group (X = 12.75). The t value for both dif- 
ferences is 6.098, .p> .001. The GT score for the FDO group was significantly 

A .. 

greater <t = 6.936, p > .001) than the FDS GT, which in turn was significantly 
higher (t =8.113, p > .01) than the GT score for IND. 

There were also significant differences between groups for the two 
individual difference scales. The FDS T-anxiety rating was greater than both 
the FDO (t = 15.856, p > .01) and the IND (t = 13.079, p > .01) groups. There 
was no difference on the T-anxiety rating between FDO and IND subjects. The 
Rotter results. were similar to the T-anxiety scores; thaf is, the FDS rating 
was significantly higher than the scores for FDO (t = 4.190, p > .01) and the 
IND (t = 2.851, p > .01) groups. Thus, the. FDS group was characterized as 
demonstrating a higher level of Trait anxiety and a greater tendency toward an 
external locus of control. 

On initial performance, a 15-item quiz concluding the individual CAI. 
lesson (see Ind. Score in Table 6), the FDO group scored significantly higher 
than the FDS (t = 14.286, r > .001) and the IND (t = 12.806, p > .01) groups. 
Both FDS and IND groups male sf ,<^nif icant gains in their scores on the beginning 
team meas-ares. During that lessen, FDS subjects were coordinating their 
responses with the FDO subjects. IND subjects received the same instructional 
materials but were operating alone. In the integrated lesson, FDS and FDO 
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scores dropped while' the IND scores were maintai^fed at the same level as the " 
beginning team lesson scores. The "only group to significantly increase its 
score from the individual lesson to the integrated lesson was the IND (t,= 
2.083, p > .05). In fact, both FDO and FDS scores dropped from the individual 
lesson to the integrated lesson. v , 

• Figure 2 illustrates the performance of the groups. It is interesting 
to note that the coordinated training' presented to the team subjects in the 
beginning lessons did not seem to increase their individual skills substantially. 
As. each ^et of lesson materials was gauged to be more difficult, it cannot be 
stated absolutely that the team training had no effect on individual profici4ncy. 
ThT^^mparison of Fofend "fDS performance with IND is dramatic, however. The 
continuous individual training appears to lend itself to systematic performance 
increments. On the other hand, coordi^hated behavior apparently leads to 
better achievement on specific established tasks, but both FDO and FDS subjects 
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Figure 2. Lesson Performance By Group 
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demonstrated substantial performance decrements on subsequent "individually- 
oriented tasks. The findings, limited in their inferential power because of 
the small number of subjects and the anecdotal nature of the evaluation, 
indicate that there are differences between the effectiveness of team and 
individual instruction in regard to what types of behaviors are being learned. 

In addition to performance scores, lesson completion times were collected. 
Table 7 "presents the means of these times by group. 

.Table 7. Mean Times (minutes) For Lesson Completion 

All Subjects FDO FDS IND 

Ind. Lesson 27.93 26.28 27.00 

Beg. Lesson 54.81 54.81 24.51 

_/ 

' . ' • Int. Lesson 21.45 * 19.02 19.56 



As can be seen in Table 7, the only substantial difference among the groups 
occurs in the beginning team lesson. During this lesson the FDO and FDS 
subjects were working on coordinated events; the IND subjects were working in 
•an individual mode. The magnitude of the differences between the team and 
individual modes is in part due to current software limitations .of PLANIT. 
In fact, there was an appreciable difference between mean completion times 
depending on whether one team^or two teams were operating. The mean comple- 
tion time for the' former situation was 44.46 (high = 49.29, low = 41.64); 
for the latter it was 59.97 (high = 63.66, low = 54.03). In short, although 
an increase in mean completion time was expected for the teams, the magnitude 
of the reported difference is not due solely to the nature of -the coordinated 
activity. , . ' 
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Co rrelational Analysis , The correlation coefficients and significance 
levels for the independent variables and performance scores are presented in 
Table 8. Jive independent measures and three performance scores are represented 
in the matrix. c 

Of the five independent variables, GT correlated more highly and more 

r 

consistently with task performance than did any of the other variables. 
Rotter correlated significantly (r = .34, p = .016) with the individual 
lesson score but the correlation coefficient diminished over the other two 
lessons. The same was true of educational level. This variable had a 
relatively high correlation with the individual lesson score (r == .43, p = 
•003); then dropped appreciably in magnitude and had a direction change. As 
was expected, anxiety negatively correlated with all task performance measures. 

In addition to product moment analysis, stepwise regressions were run 
against the dependent variables of individual lesson score and beginning 
lesson score (see Tables 9 and 10). The independent variables regressed 
against individual lesson score were years in service, educational level, GT, 
anxiety, and Rotter. The beginning lesson score regression also included the 
individual lesson score as an independent variable. 

As can be seen in Table 9, the multiple correlation coefficients are 
reasonably substantial for aj.! three groups. The order and magnitude of the 
independent variables change across groups, however. For FDO and IND, Rotter 
and GT account for the preponderance of the explained variance. For FDS, the 
two variables contribute substantially less to the multiple R. 

The regression against the beginning team score also resulted in substan-- 

j 

tially high multiple correlation coefficients. What is interesting^ is the 
comparison of the two regressions. As anticipated, the order and magnitude 
of the independent variables for both IND regressions are similar. Rotter 
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Table 8. Correlation Coefficients and Significance Levels for '' 
Independent Variables and Performance Scores* 

Y 



t 


006 , 
, Educ, 
Level 


007 

, GT 


008 
Anxiety 


009 

Rotter 
Scale 


■ 010 
Ind 
Score 


012 
Beg 
Score 


016 ' 
Int 
Score 


\ 

uu) lears In bervice 


-.16 (.156) 


-.11 (.167) 


-.12 (.231) 


-.27 [M] 


-.04 (.403) 


.22 (.089) 


-.09 (.304 


uuo hciiic. Level 


1.000 


.15 (.198) 


-.18 (.133) 


.28 (0.43) 


.43 (.003)' 


-.06 (.350) 


.07 (.324) 


UU/ bi . 




1.000 


Art / t\ m t \ 

-.28 (.054): 


.31 (.036) 


.21 (.109) 


.42 (.006) 


.35 (.021) ' 


UUo Anxiety 

■\ 






1.000 


-.35 [M) 


-.21 (.095) 


-.16 (.166) 


-.20 (.117) 


009 Rotter ■ 

h- 








i.UUU 


.j'l l.Uio) 


.16 (.159) 


A A / f\f\ f \ 

.09 (.306) 


010 Ind. Score 










1.000 ' 


.28 (.039) 

\ 


.2.8 (.04) 


012 Beg. Score 












1.000 


, ,.29 (.041) 



^Figures in brackets' are levels of significance • 
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Table 9. Summary of Stepwise Regression. 

Dependent Variable: Individual 
Lesson Score 



Variable 


Multiple R 


r2 


Change 


0 

Simple R 


B 


Seta 






Group : 


FDO 








Rotter 


,50 


.25 


25 


.50 


.02 


.06 




.JO 


. 31 


6 


.46 


.01 


.08 


Education 


.58 


.33 


2 


.03 


--.53 


-.33 


Years in Service 


.59 


. 35 


1 


-.33 


-.26 


-.53 


Anxiety 


.65 . 


.43 


8 


-.39 


-.17 


-.50 






Group : 


FDS 








Education- 


.68 


.46' ' 


46 ' 


.68 


1.26 


.r.6 


GT 


.70 


.49 


3 . 


.27 


.08 


.19 


Rotter 


.70 


.49 


0 


.07 


-.04 


-.06 






Group : 


IND 








Rotter 


.73 


.53 


53 


.73 


.82 


1.01 


GT 


.83 " 


.6r 


16 


.36 


.13 


-.47 


Years in Service 


..88 


.77 


8 


.08 


-.20 


-.35 


Anxiety 


. .91 


.82 


5 


-.34 


.14 


.29 


Education 


,'91 


.83 


0 


.45 


.16 


.07 
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Table 10. Summary of Stepwise Regres5?on. 

Dependent Variable: Beginning 
Lesson Score 



Variable 


Multiple R 


^2 „9 
R'' R^ 


Change 


Simple R 




Beta 






Group : 


FDD 








GT 


.56 


.3.1 


31 




.12 


.41 


Education 


.61 


.37 


. 7 


-.IS 


-.96 


-.32 


Anxiety- . 


.67 


.44 


7 


-.53 


-.23 


-.37 


Ind. Score 


.68 


.46 


2 


.18 


-.34 


-.IB 


Rotter 


.68 


.46 


0 


.22 




.08 






Group : 


FDS 








GT 


.46 


.21 


21 


.46 


.20 


.51 


Rotter 


.59 


.35 


lA 


-.29 


-.24 


-.38 


Education 


.66 


.43 


8 


-.26 


-.95 


-.54 


Ind. Score 


.71 


.51 


8 


.13 


.36 


.39 


Anxiety 


.72 


.52 


1 


.13 


-.05 


-.12 






Group : 


IND 








Rotter 


. .58 


.34 


34 


.58 


.63 


.45 


Anxiety 


.60 


.36 


'3 


-.20 


.T3 


.15 


GT 


.61 


.37 


1 


.12 


.11 


.22 


Ind. Score 


.62 


.39 


2 


.48 


.57 


.33 


Education 


.63 


.40 


.■"1 


.18 


-.41 


-.3.1 
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and GT consistently account for the multiple R. The only difference in order 
is the introduction of aftXl^ as contributing mor^ to the e.cplained variance ■ 
than GT for the beginning team score. The magnitude of all independent 
variables is less in the second regression. As stated earlier, the similarity 
in the ordering of the independent variables was expected as IND subjects 
were working in a similar mode during both lessons. 

On the other hand, the FDO and FDS subjects were working in a coordinated 
task environment during the beginning team lesson. As one ca i see. in compar- 
ing the regressions for these groups the order and magnitude of the predictor 
variables changes significantly from individual lesson to beginning lesson. . 
In fact, the order is nearly reversed. For example, the >rientat.::m measure 
•(Rotter) was ordered first for the FDO individual lesson scors. For the FDO 
beginning lesson score it was "ordered last. The r2 contributi< changed from 
.25 to 0. In addition, GT and Rotter accounted for only 3% of the r2 for 
the FDS individual lesson score. lor the FDS beginning .core, the cor.-:ribution 
of these two variables increased to 35%. 

In Short, there appears to be little stability among independent variables 
for explaining variance in scores between individual and team contex,... It 
should be noted, however, that the analyses were based on the individual 
characteristics of the team members. The composite of the teams was not 
identified and used as an independent variable. It may well be that by 
analyzing combinations of member characteristics, more systematic exp-. .mat ions 
of task performance could be derived. 

Role Perception and Attitud lnal Measures . Data collected during the 
emergent team lesson included subject responses to four tactical scenario 
situations. In each of the four cases, the FDO. FDS, and IND subjects were, 
required to make a decision regarding how they would structure the team in 
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order to perform the task involved in the scenario^ In regard to the IND 
subjects, the decision-making process itself was artificial in that* the 
individual team member had neither worked in a team mode during any of the 
previous lessons nor would be working with another" individual during the 
emerfv^iit team lesson. After each decision was made, subjects were administered 
seven items which related to their confidence in the decisions and their 
l^sercepti- s of the roles of the team members. 

Table 11 presents the distribution of decision responses by FDO, FDS and 
IND. In all cases, once the decision was made subjects received hypothetical 
feedback reporting the efficacy of the decision that they had. made • As cian 
be seen in Table 11 9 the three responses available to the subjects were (1) 
to totally delegate at least one of the taisk^ to the FDS, (2) to delegate 
tasks to the FDS but provide monitoring, and (3) not to delegate any tasks to 
the FDS. In each case, there was a preferred response, an acceptable response 
and a wrong response. The rating of the responses was based on the complexity 
of the task situation and the criticality of the combat evolution. 

The purpose of the lesson was to. see how well the subjects, particularly 
FDO, responded to emergent tactical situations. In prior lessons, the scenarios 
had evolved, in essence, frame by frame with each combat situation building 
' from prior events. In the emergent team lesson, the subjects were presented 
with a total picture and the parameters of particular combat situations. 
Also, the lesson allowed the project team to investigate the impact of a 
direct team feedbaclc message. That is, in the past the team members were 
able to follow the performance of each other in terms of their error rates 
and time for responses as well as receiving team debrief ings. In the emergent 
team lesson the feedback message only had to deal with a hypothetical outcome 
to a tactical decision. A third objective of the lesson was to collect data 
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Table 11. Distribution of Decision Responses 
in Emergent Team Lesson 





Delegate 


Del/Monitor 


Not Delegate 






1st Decision 




FDO 


3* 




. 1 


FDS 


1* 




1 . 


IND 


1* 




U 






2nd Decision 




FDO 




6* 


3 


FDS 




7* 


2 


IND 






O 

z 






3rd Decision 




FDO 




3* 


3 


FDS 


3** . 


5* 


2 


IND 




1* 


3 ^ 






4th Decision 




FDO 


3** 


5* 


2 


FDS 


3** 


3* 


4 


IND 


5** 




1 



^Acceptable Response ^ 
**Preferred Response 



\ I 
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from the individual team members in regards to their confidence in the 
abilities of their teammates and regarding the perception* of their roles 
within the team context. 

As can be seen in Table 11, the preferred response to the first decision 
was to delegate responsibility and continue to monitor the performance of the 
FDS, .The preponderance of all subject groups selected this response. For 
the remainder of the decisions, the preferred response was to totally delegate 
at least some task, comprising team mission. The feedback messages related to 
each of the decision choices were as follows: (1) for the preferred response, 
the feedback message in essence stated that the team. had performed success- 
fully and achieved their mission; (2) for the acceptable response, the feed- 
back message stated that the team was partially successful in achieving their 
mission; and (3) for the wrong response, the team was told that it had failed 
to achieve its mission. Each of the feedback messages were more elaborate, 
and the feedback was cpnstructive in, that it explained the basis for the 
decisions as well as the feedback message,' It is interesting to note in 
Tat)le 11 that after the second decision when the delegate/ monitor response 
was giving only a partially successful score, a number of the subjects began 
to switch and search for the more appropriate response. However, except for 
the individual isubjects, there was a continuing dependence on the delegate/ 
DK&nitor response throughout each of the spenarios. 

The responses to the seven confidence and role perception items were on 
a five point scale. Table 12 contains the response means and standard , 
deviations for the confidence and role perception items. The seven items 
were as follows: 
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Table 12. Means and Standard Deviations For Confidence 
and Role Perception Item Responses. 



Variable FDO fDS 







V 

A 


(S.D.) 


X 


(S.D.) 




X 


(S.D.) 


uuJNr lu— J. 


4 , 


. 00 J 


(.94) 


4.20 


, (-.92) 


3, 


.75 


( 


.96) 




/, 

Hi 


> UU - 


(.82) 


3. 50 


(1.18). 


3. 


,75 


( 


.96) 






. ZD 


(.79) 


3.50 


(1.35) 


2. 


,75 


( 


.96) 


CONFID-4 


3. 


80 


(.79) 


3.50^ 


(1.08) 


2. 


,00 


(0.00) 


DISCUSS-l 


4. 


00 


(.94) 


4.10 


(1.10) 


4. 


25 


( 


.96) 


FDOCON-1 


3. 


70 


(.68) 


3.90 


(1.29) 


3. 


75 


( 


.96) 


FDSCON-1 


3. 


50 


(.85) 


3.80 


(1.03) 


4. 


25 


( 


.96) 


COMPCON-1 


4. 


50 


(.707) 


3.90 


( .99) . 


4. 


75 


( 


.50) 


MISDEP-1 


4. 


50 


(.85) 


4.20 


(1.69) 


3. 


00 


(1 


.41) 


FD0>FDS-1 


3. 


00 


(.82) 


3.40 


( .70) 


3. 


25 


(1 


.26) 
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1. How confident are you in the FDO^s decision? (C0NFID-1,2,3,*4) 

2. Would you have preferred to discuss the decision with the FDO before 
it was in^de?^ (DISCUSS-1) 

, 3. Should the FDO conduct fire yiissions" (FDOCON-1) 

4. Should the FDS conduct fire missions? (FDSC0N--1) 

5. Should the most competent t_eam member conduct the fire missions? (COMPC 

6. Who conducts the fire missions should be dependent upon the situation, 
and the team mission. (MISDEP-'l) 

7. The FDO is better than the FDS at conducting fire missions. (FDO > FDS- 
Overall, the responses led to few insights regarding individual behaviors 
within the team context and perceptions of the roles' of the individuals. The 
FDO subjects demonstrated a slightly greater confidence in the decisions that 
they made than did the FDS subjects. Perhaps. more important was that two 

items which received high scores were 5 and 6. Thus, both team members 
perceive that the structuring of the team should be based on both the competence 
of the individual team members as well as the characteristics of the overall 
team mission. - ' 

No measures were taken of the individual member's attitudes towards the 
lessons themselves. However, it should be noted that throughout the experi- 
mental session^, subjects frequently commented on how interesting the lessons 
were. It was ,also noted by the project team that during the debrief ing 
sessions, subjects took the problem seriously and quickly began to talk and 
behave towards one another as if they were working in an. actual artillery 
combat environment.. In short, the richness of the scenario seems to accomplish 
its objective of getting the subjects immersed In the training situation. 
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DISCUSSION 

Major Team Issues 

As posited in section two, there are three major team issues which 
should be considered in the development of a program of team training or team 
training research. These issues are team definition, conceptual team models, 
and team structure. Clearly definition criteria for categorizing multi- 
person operations ipust be established. For the present study, the criteria 
include (1) rigid structure, organization, and communication networks, (2) 
anticipation of an individual's task participation, and (3) cooperation and 
coordination; Thi. definition distinguished the team from a small group and 
from individuals performing individual tasks in a group context. 

The issue of conceptual team models is based on the situational context 
in '•^hich team behaviors occur. Prior research- indicateWthat the situational 
context is a continuum stretching between end point;s which may be described 
as established or emergent. Team operations, characteristically, cannot be 
ascribed to any one point along this continuum. On the contrary, the situa- 
tional context of team task performance will fluctuate all along the continuum. 
For training' analysis, it is important to identify the critical fluctuations 
and to represent these in the team instructional strategies. 

Team structure, serial or parallel, drives the types of team member 
Interaction required in the performance of team tasks. Thus, the identifica- 
ti6n of the form of the team structure at each task mode is a vital input to 
the design- of training events and to the development of team instructional 
strategies. Both serial and parallel structured events occur within the • 
sil^aational continuum. 

In summary, these issues point out that team operations are. comprised of 
a number of dimensions: the defined interrelationship of the members, the 
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team mission and tasks to be performed, the structure of the team vis-a-vis 
tasks, and environmental conditions. In the development of a training program, 
a job/task and training analysis that will yield the required information 
regarding each of these elements should be employed. In the design of a 
research program, each of these considerations must be weighed against the 
established purpose of the research. As can be seen, these major issues have 
driven the methodologies for achieving the stated project tasks. 

A Conceptual Framework for COLT^ Instructional Strategies 

The conceptual framework is based on the definition of an instructional 
s^^ategy as the product of a series of decisions which lead to the sequencing, 
structuring and specifying of learning events and activities. It was concluded 
that the information underlying these decisions is related to the characteris- 
•tics of (1) the task to be learned, (2) the learner, and (3) instructional 
delivery system. In turn, team instructional strategies must account for the / ' 
variables representing each of these dimensions within a context typically 
requiring multi-person interactions. That is, the coordinating and cooperative 
behavior present in the job must also be present in the' training. 

From the team task dimensijy^^^id^tlf ied in the literature and through 
interviews"" with team training instructors, three categories' of:^team learning 
were developed to serve as a link between team job /task analysis, team train- 
ing objectives and team instructional strategies. The three learning categories 
were knowledge of team roles, team attitudes, and team. communications. Each 
of the categories are discussed in greater detail' in section three. It 
should be noted, however, that these three learning categories were derived 
anklytically and have not been empirically tested. ' ^- '' 

|. Learner characteristics and strategies which are described and discussed 
in this report were limited to those related to individual behavior. Emphasis 



was given to characteristics which impact on the ability of the student to 
process information, communicate, make decisions and to solve problems in a 
coordinated task environment. In terms of individual learner strategies, 
three categories were discussed in section three. The categories were made 
up o£ co!i?>rehension, memory, and problem-solving strategies. 

Both learner characteristics and strategies may be used as the basis for 
C0LT2 instructional strategies in the form of preprogrammed decisions for 
teaching. Preprogrammed decisions frequently are a function of projected 
trait or entry attributes. To some extent, consideration of state character- 
istics such as the performance on the last task or the current state of 
anxiety departs from the concept of entry behavior description because these 
measures may be used as dynamic indicators of a learner's state. Learner 
characteristics and strategies, however, to be relevant to C0Lt2 must allow 
for analysis of learner characteristics which will be used in designing 
instructional strategies and those which will be used in the instructional 
manipulations in a real-time, dynamic, interactive mode. 

The third dimension of the conceptual framework focused on the capability 
of the instructional medium, CAI. C0LT2 instructional strategies will reflect 
hardware and software capabilities present in the selected CAI, system and the 
operating system available. In short, instructional strategies are delimited 
by the medium through which the learning is to occur. 

The conceptual framework served well as an organizer of the instructional 
strategy data base. However, there are two deficiencies in the framework. 
First, the data base does not encompass theoretical and empirical knowledge 
related to small group behavior which may be . applicable to team training- 
instructional strategies. Most important among these would be the process 
paradigms reflecting the different types of contextually related interpersonal 
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relationships. Identification of these processes may significantly contribute 
to the development of evaluation paradigms as part of an instructional system 
development model for team training. Secondly, while the conceptual frame- 
work served well for organizing the data base, it lacked procedural guidelines 
for translating the data into^actual instructional strategies for specific 
TACFIRE team training problems. 

Implementation of a Team ISD Model , 

Section four contains a description of the design and implementation of 
the team ISD model for the purpose of the brassboard development. The major 
components of the approach included job/task analysis, development of team 
learning objectives, and scenario development inclusive of instructional 
strategies. 

The team ISD model employed in this project has notable strengths and 
weaknesses. Foremost among its strengths was the efficacy of implementing 
the job task and training analysis. The analysis methodology based primarily 
on the work of Glanzer (1961) yielded the discrete tasks comprising the 
TACFIRE fire mission with both situational context and team structure dimen- 
sions identified. The job/task flowcharts developed from this analysis also 
proved exceptionally efficient as vehicles for translating the job/task and 
training analysis into training scenarios reflecting not only the task to be 
performed but also the environmental conditions to be simulated. 

The weaknesses of the team ISD model were in two directly related areas. 
First,, a distinct deficiency of the model was revealed in the formulation ''of 
team' learning objectives. The model lacks the methodology for preparing 
terminal and enabling objectives and analyzing the objectives by learning 
category. This deficiency is also related to the lack of evaluation procedures 
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in the model. More specifically, evaluation of the member acquisition of 
team skills (i.e.; coordinating and cooperative behaviors) is not present. 

In summary, the iSD model offers a sound base for developing team 
instructional strategies and team training. However, the model is not suf- 
. ficiently detailed to lend itself as an operational or procedural guide for 
the general production of team training curricula. . . 

PLANIT Injplementation ^ 

The PLANIT implementation was described in terms of the team training 
considerations of (1) storage and retrieval of information related to scenario 
events, communications , learning events sequences, and student performance . 
via the common data base, (2) initialization of lessons, (3) synchronization ' 
of team members to scenario events, and C4) communications among team mem-^ 
bers. Section four describes how these team CAI considerations were matched 
with the PLANIT team training directives in the development of the team 
training brassboard. The present discussion will emphasize the problems 
encountered in the development of the brassboard and potential enhancements 
of the PLANIT team training version. Among the proposed enhancements will be 
some considerations for authoring capabilities. 

The common data base implemented in PLANIT was adequate f(^ programming 
the instructional strategies, tracking of events, and synchronization of the 
subjects to scenario events. The u&e of the common data base for these 
purposes involved only a matter of appropriate design of the matrix in PLANIT. 
However, if team training lessons in the future are to be implemented by Army 
instructional personnel, then it may be desirable to provide commam-J with 
parameters to "set the values of the common data base indicating sequences of 
events, automatic designation of terminal values, and synchronization require- 
ments. It is recognized that to make the matrix a primitive would consume 



space and likely add unwanted constraints on author flexibility. However, if 

' . • . ' i 

.the lesson can be designed and coded by an instructor, time savings and cost 
effectiveness could be realized. One possibility, fo-r example, might be that 
the author could designate a directive HOLD with parameters indicating the 
frame labels on which a team member might be held. A HOLD directive parameter 
would also have to designate the other team members with which the holding 
action would be compared. Thus, synchronization {)'arameters could be established 
in a preformed matrix with authoring directives tot either sequencing events 
or holding students. 

The PLANIT system could automatically put the frame numbers of these 

labels in the data base with the designated* terminal values fo';r determining 

\ 

\ 

which program was operating. When a label was reached and a frame execut^^d^ 
the frame cbuntcr for comparison and branching (similar to the use of matrix 
celJ X(3,3,l)) would be automatically implemented. In this way, the burden 
of building spec^ic synchronization techniques as well as the design\of the 

common data base would be taken off the shoulders of the author, 

t ■ ' - . 

In the lessons implemented fbr the study^, all contenlc of the communications 
was ca&ied. That is, Xhe messages were preprogrammed as part. of the lesson 
data base. To allow the student to make up his own message is also possible ' 
withlii PLANIT via student-initiated DIAL directives. In this manner, the 
student controls the content. This capability was not used in the lessons 
developed because there are distinct implications for both instructional and . 
evaluation strategies. 

For the purpose of the brassboard several instructional strategieis for 
teaching team communications were considered but not iuqplemented because of 
current PLANIT restrictions. For example, instead of asking an FDO subject 
to select the appropriate action by number and sending the canned message to 
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his FDS partner, it was . i allow a free interchange of DIAL messages 

between the two. If such a ■ were followed with rules defining the 

FDO and. FDS roles, it might be lu... beneficial for transfer to the actual 
target task than the .strategy en\tsloyed. However, at present, there is no 
capability to record or diagnose ^>uch an interchange automatically, 

Jif messages could be stover. :,}ry^ searched for key words or phrases, CAI 
strategies could be employed to diagnose the state and content of communications. 
This information would allow prompting ,* interception of messages from one 
member to another, or branching ^strategies . Without the capability to store 
and diag^iose the message, the interchange is not only free .form but so are 
the instructional strategeies. 

It is also desirable to have PLANIT authoring strategies. Such strategies 
(70uld have the purpose of providing a framework in which the logical and 
empirical J>as is for- team training is associated with authoring' techniques . 
Cn this way the instructional teclmology of team training can be naljen into 
account. The general design used in lesson building for this study was, to 
sequence lessons according to four levels: (1) individual, (2) beginning 
:eam, (3) integrated, and (4) emergent team. These levels may be directly 
:ied to the modes of the CAI team training as each relates to the -student 
characteristics, the'^instructional objectives, and the instructional strategies. - 
rhat is, some CAI modes may be more or less appropriate at each level of team 
zraining. For exaiople, using the CAI modes listed by Hickey (i968), one 
light find the match of CAI modes with lesson level as presented in Table 13. 
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Table 13« Example of Match of Team Lesson Levels' 



with CAI Modes \ > 




Lesson Level 


CAI Mode 


1. 


Beginning Team 


Drill and Practice 

Tutorial 

Testing 


2. 


Integrated Team 


Socratic Tutorial 

Simulation 

Testing 


3. 


Emergent 


Simulation 
Game 

Learner ControlLad 
Testing 



The advantage o-f an author strategy can be illustrated by describing 
current scenario implementations common to *team training' for all branches 
of the unilitary . The scenarios characteristically begin with simple events 
with lohg lead times. As the student progresses through the scenario, events 
increase in number and difficulty. The instructional strategy usually is 
driU-and-rpractice and testing with task (mission) achievement b^ng the only 
measured outcome. Seldom aia tutorial, simulation, learner controlled, or 
game strategies employed. If COLT^ is to be more than a drill and practice 
experience, the training scenarios must be rich with team instructional 
strategies. 

Brassboard Demonstration/Evaluation 

As'descrlbed in the. preceding section, subjects for the brassboard 
demons t rat ion/evaluation were 40 Army enlisted men from commands in the 
Washington area. Eight of the subjects trained on the brassboard in an 
Individual mode; the remaining 32 were placed in two-man teams. One team 
fflenber randomly was selected to 'serve as the FDO. The other man was the FDS. 



Drill, tutorial, problem complexity in sequencing, and individual 
feedback strategies were the same for all subjects. The teams, however, 
worked through the beginning team lesson and selected frames of the integrated 
and emergent lessons in a coordinated mode. In addition, tp.am debrief ings at 
the conclusion of the lessons were more extensive, with team members being 
apprised of each other's performance and having the opportunity to discuss 
future role assignments. 

A few minor problems were encountered in the evaluation of subjects. It 
was not possible to acquire lesson times for the first eight subjects. Minor 
modifications of PLMIT corrected this problem. Second, the responses made 
by subjects were not recorded initially. The only record that was. stored was' 
the correct response to the item and whether the subject was right or wrong. 
This resulted in a problem in deriving performance scores as one response 
choice was a query for information and should have been scored as a neutral 
response. Again, a minor modification to BLANIT was required to correct the 
problem. 

The conclusions to be drawn from the data collected during the demons tr a- 
.tion/evaluation are limited. This is due, for the most part, to the limited 
number of subjects and to the few problems encountered in the data collection 
itself. However, comparisons of team and individual subject performance, 
regression analyses of individual and team scores, and analysis of student 

attitudes and role perceptions towards the instruction lend themselves to 

J, 

some interesting observations. 

A critical question regarding team training is whether or not the types 
of learning which occur in coordinated training differ from the learning that 
takes place in individual training. Several outcomes of the evaluation 
indicate that this very well may be the case and may warrant subsequent 
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Investigation. In the across-lesson performance of the groups, it should be 
noted that the coordinated training received by FDO and FDS subjects did not 
appear to substantially increase their individual skills. On the othfer hand, 
the team performance on coordinated tasjcs was better than the IND subjects 
who W6re working on the same tasks in an individual mode. In short, it 
appears that team trained subjects acquire skills other than task proficiency. 
Moreover, those skills contribute to effective job performance. 

A second indication that different, but critical, skills are being 
learned in the team training environment is derived from stepwise regression 
analyses of individual -and beginning team lesson scores. There is. little 
consistency among independent variables for explaining variance in scores ^ 
between individual and team contexts. On the other hand, across individual 
scores, there is much greater stability in the explanation of variance. 
Further, the correlation coefficient between lesson performance for IND 
subjects was .48. The correlation coefficient between individual performance 
and team performance for the FDO subjects was' .18 and for FDS subjects, .13. 
The differences are substantial. 

In regard to role perception and attitude, there also were some in teres tinj 
observations. On all four confidence items, FDO and FDS subjects indicated 
that they were. more confident of the decisions made than were IND subjects. 
While it is difficult to explain the differences, it appears that the inter- 
active, decision making training resulted in greater confidence in self and 
other team members. One other point of difference between team and individual 
.role perception relates to the perceived dependence of team structure on 
mission. Team subjects perceived thii3 dependence to be significantly more 
important thaii did individual subjects. Thus, team, training may contribute, 




to. a large degree, to increased awareness of tactical environmental conditions 
as well as self and other team member competence. 

A final remark regarding attitudes is warranted. As stated earlier, 
many of the subjects favorably commented as to their interest in the lessons. 
The progressions or levels of training, with their increasing reliance on 
tactical combat simulation and gaming, seem to stimulate subject motivation 
and interest. This occurred in spite of the fact that the coordinated 
lessons ran extremely slow, and subjects did have idle time between frames. 

In summary, the results of the initial COLT^ brassboard -demonstration/ 
evaluation support the basic tenets underlying the methodology. Representing 
the situational context of the job* performance is critical to effective team 
training. Analysis of team structilre in the performance of jobs can yield 
dimensions of team member interactions which may be critical to job/task 
proficiency yet are distinct from individual proficiency skills. Finally, 
these separate and distinct team dimensions can be successfully subsumed, 
along with relevant individual training dimensions, under team instructional 
strategies. Further research into each of the topics covered in the discussion 
should lead to clarification of the relationships which exist among the 
topics and contribute to a comprehensive team ISD model. 
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RECOMMENDATIONS 



The following Tecommendations are categorized as they relate to the 



(1) development of a team ISD model, (2) enhancement of the team training 



version of PLANIT, and (3) team training research requirements. 



Recommendations for Developing a Team ISD Model 

The implementation of the team ISD model revealed a number of strengths 
and weaknesses. These were discussed in the previous section. Generally, 
however, the model is insufficiently fleshed out to serve as a step-by-step 
procedural guide to the development of team instruction. .The following 
paragraphs contain specific recommendations for addressing the weaknesses of 
the model. 

The conceptual framework for COLT^ instructional strategies, established 
in this project, has two major def iciences. First, it does not incorporate 
applicable knowledge related to small group behavior. Second, 'while the 
framework serves well as a vehicle for organizing a team instructional 
strategies data base, it does not lend itself to the specification of actual 
strategies for a specific training problem. Recommendations are: 

1. Applicable small group behavior knowledge should be incorporated 
into the team instructional strategies data base. 

2. The potential for developing procedural algorithms which optimally 
mix the training specifications, trainees, learning activities, and 
instructional delivery systems should be investigated. 

Most important the model did not yield adequate learning objectives 

representing team training requirements. Consequently, the model does not 

provide adequate evaluation paradigms for assessment of team skills and 

measurement of the objectives. That is, while it is possible within COLT^ to 
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evaluate Individual and team achievement and the 'procedures for doing so are 
relatively straightforward, the interactive processes are not assessed. In 
view of this the following recommendations are offered: 

3. Specific directions for preparing team terminal and enabling learning 
objectives should be developed. Included should be a methodology for 
appropriately categorizing objectives by types of team' learning to 

^ ■ 

^' !^ould\rf "^"J?"" paradigms for assessing team interactive behaviors 
should be investigated in terms of their potential for Appropriately 
. being matched with specific team situations as def ined'bfteam tasks 
'l^f^Z^^''''''^''''^' ^^''^^o^W^^t^^ conditions. To be applicable to 
COLT , evaluation models would have to be amenable to PLANIT pro- 
\ gramming. ^ 

Recoimnendations for PLANIT Enhancements ' 

The operational requirements for a team version of the PLANIT CAI system 
fell into four categories: (1) a dommon data base to be used for program^ ^ 
control, event tracking, and individual/team record storage and analysis; 
(2) initialization of common lessons; (3) synchronization; and ..(4) communica- 
tions. . The following recommendations reflect this categorization. 

5. The establishment of a common matrix as a primitive should be 
^?o^"f f'^' ^"'^h an action would constrain Hhe implementa- 
tion of ^instructional strategies (i.e., reduce the flexibility of 
a^^n^f r to manipulate program logic) . there would be considerable 
gain in facilitation of authoring. ^Matrix parameters could b^set' 
for preprogrammed analysis "of individual and tedm responses in 
order to dynamically manipulate students and instruction. Predefined 
matrix^parameters would be tied to the following recommendations 
regarding synchronization and cgipmunications . 

6. Team^lessons require synchronization. Currently the required 
coordination is available only via development of tailored program 
logic. A synchronizing directive would reduce the current require- 
ment that the author have extensive knowledge of PLANIT programming 
techniques. roe 

7. Free text or partial free text communications -which are terminal 
BT^^ir^'^ ^""^ ^ desirable feature of C0LT2. However, the current 
PLANIT team version does not have the capability to record and 
analyze this type of message. This capability is required if 
student performance analysis and problem diagnosis are to be incor- 
porated in team instructional strategies. 
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8. Minor modifications in message characteristics are being addressed. 
Foremost among them are message identification, message length, and 



^ *»^«si*ua.j.x»«auxuu, message xengtn 

queuing considerations. Dr. Charles Frye is presently working 
some of these problems. 



on 



9. Authoring strategies for C0Lt2 should be developed. Such strategies 
would direct and teach the instructor-author to create instructional 
strategies which optimally configure student interactions, learning 
events, and CAI modes available in PLANIT. 

Recommendation for Future C0Lt2. Research 

.Given the positive findings of the present study, continued testing of 
C0LT2 instructional strategies so that their full potential and applicability 
can be realized is recomended. Specifically: 

10. COLT research focusing on the relationships between team personnel 
composites, performance, and interactions should continue. The 
proposed research would require an extensive experimental effort in 
order to establish a data base of discriminant, team characteristics. 
The critical factor then would be to define the relationships of 
between. team characteristics and differential instructional treatments. 

11. In order to fully assess the impact of team training, process 
evaluation models that track team member interaction and identify 
non-task prof iciency skills should be investigated. Thus', types of 
team interactions and 'team skill* acquisition could be related to 
task achievement within environmental and team structure contexts. 

12. Further research on the effectiveness of presenting team training 
by levels related to tactical complexity and evolutions is certainly 
required given the promising trends found in the present study. In 
addition, such an investigation should focus on determining if 
learning stab^jlizes across mixes of individual and team instruction. 
Positive findings would significantly impact on both computejf-based \ 
and noncomputer-based team training. 
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